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ABSTRACT 

The Stanford-Denver Project is a continuing study of 
elenentary school Spanish instruction. These five docuients report on 
various aspects of this study, especially the use of new technology 
to make instruction of Spanish nore efficient. The first study 
details the construction of a listening coiprehension test which 
could be given via television to students who can neither write nor 
read Spanish. The second discusses the developient of prograned 
learning naterials for Spanish instruction and their effectiveness. 
The third docunent presents the results fron an experinent testing 
different utilisations of instructional television. The fourth 
reports on experinents done to deternine the proper tine to begin 
study of written Spanish, and along with the fifth study, conpares 
teacher instruction with autonated instruction. A conbination of both 
technigues is found to be preferable to either alone. The fifth study 
exanines the use of audio aids in earlier grades and finds then 
efficacious. (BB) 
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SUMMARY 



The Problem 



Measurement is extremely important in the Denver-Stauiford project 
since different teaching techniques are being compared. The audio-lingual 
methodology employed in teaching first year Spanish to fifth graders, how- 
ever, creates special difficulties in test construction. Pupils can neither 
read nor write in Spanish, and trauislation to English is strictly avoided. 

The presence in classrooms of teachers of widely varying language backgrounds 
means that television administration of any pencil-and-paper test is necessary 
to assure similar testing conditions. 



Results 



Three pencil-and-paper, TV administered tests, designed to measure 
listening comprehension skills, were developed during the I 96 O- 6 I school 
year. Validity, reliability, comprehensiveness, discrimination, and certain 
other principles suggested by language experts were carefully considered dur- 
ing the development. The lack of an outside criterion against which to com- 
pare obtained results made assuring validity a problem. Careful definition 
of course objectives and a detailed content analysis showing the emphasis 
given each lauiguage element during TV instruction, however, provided for the 
strongest kind of construct validity. Extensive pre-testing and analysis of 
results of the actual TV administrations showed that the other criteria for 
test development and use were satisfied. 

Two general types of test items were used. The first had pictures on 
each pupil’s answer sheet, and the pupil responded by matching a picture to 
a statement spoken by the television instructor. The second type required 
choosing one of two possible alternatives (true or false, 1 or 2) in response 
to a statement or statements spoken by the instructor. In each test the pic- 
ture items were substantially better them the others in terms of discrimina- 
tion and the "1 or 2" alternative items were poorest. 
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The Denver Public Schools and Stanford University’s 
Institute for Communication Research are currently engaged 
in a joint research project on the context of instructional 
television. The purpose of the project is to learn how 
instructional television can best fit into the total teach- 
ing situation. A substantial amount of research has estab- 
lished that television is a very effective teaching medium. 
Ways of combining it with other educational activities must 
now be considered, and the Denver-Stanford project is a 
beginning effort in this direction. Kenneth E. Oberholtzer 
is principal investigator for the Denver Public Schools 
and Wilbur Schramm is principal, investigator for Stanford 
University. This is one of a number of project progress 
reports. 



1. THE PROBLEM 

The Denver-Stanford project was wholly concerned during the first 
year with the beginning level (Level I) of Spanish instruction. More than 
6,000 fifth grade pupils in the Denver Public Schools served as subjects. 

Level I instruction in Denver is entirely audio-lingual; pupils hear 
and speak Spanish but do not read or write. Almost all conversation is in 
the second language. English is used occasionally by the instructor to ex- 
plain but never to translate. The learning situation is kept as natural as 
possible; formal grammar, lists of vocabulary words, and isolated language 



elements out of context are shunned. This teaching methodology is based on 
experience gained by developers of the FLES (Foreign Languages in the Elementary 
School) program and is highly recommended (Andersson, Brady, et. al., 195^; 
Peloro, Hughes, Bowen, et. al., 1959; Brooks, I960; Keesee, I960). 

Measurement is an unusual problem in this situation. Subjects cannot be 
asked to write any answers in Spanish since no writing skj.lls have been de- 
veloped. They cannot write in English since translation is avoided. They are 
unable to read in the second language. Furthermore, no hard and fast rules for 
development of language tests are available. Nelson Brooks states that "there 
has been no systematic synthesis, based on a careful examination of what lan- 
guage is and how it is learned, of a testing program that will measure success 
in second-language learning" (Brooks, I960, p. 157). Finally, creating similar 
testing conditions for all 6,000 subjects is a challenge, since an unusual 
divergence in the classroom teachers' language backgrounds exists. 

Circumstances, then, have dictated the development of a listening test 
requiring no reading, or writing, or translation; a test which can be given 
via television to assure uniform administration, pronunciation, visual presen- 
tation, and the like; and a test developed entirely by staff personnel without 
the benefit of prior ejqperience or reported test development upon which to rely. 
In short, a locally developed listening comprehension test is dictated. 

Is such a test suitable for measuring achievement at the beginning level 
of elementary school Spanish instruction^ Experts in the field indicate that 
listening comprehension at this level is of extreme importance. 

Brooks calls training in listening comprehension the first objective in 
language instruction and says that 50 per cent of the time in Level I should 
be devoted to developing listening skills (Brooks, I960, p. 123)* Huebener 
states that the learner's lister xng "with care and discrimination" is necessary 
to the development of good pronunciation and that boLh listening and pronunci- 





ation skills are "absolutely essential to accurate derivation of meaning from 
a second language and to later developm> ^ of reading and writing skills" 
(Huebener, 1959 i PP* 11-12). 

Brooks suggests several principles which should be followed in building 
listening comprehension tests. Specifically » he says that this type of test 
should: 



contain no English, no dictation, no anecdotes, and no 
incorrect forms, "^he stimulus (should be) directed ex- 
clusively to the ear. The response (should be) the choice 
of a picture that correctly matches what is said (Brooks, 

i960, p. 161). 

His more general suggestions are: 

Test vocabulary only in a context of normal speech or by 
pairing naturally associated words and expressions in the 
foreign language. 

Present normal problems. To associate words with each 
other, to complete a form, a thought, or a description, to 
answer a reasonable question or give a reasonable rejoinder, 
to identify or recall forms that satisfy both sense and syntax, 
to write or say what is likely to be written or said -- 
such things can be called normal problems. 

Keep the test in the foreign language. Use English only 
for directions. 

Organize the test by putting, together what goes together. 

Use only that material which i£ suited to the limits and pur- 
poses of the test and to the c-upacities of the group being 
measured. 

Give the student ample opportunity to show what he can do 
by preparing a sufficient number of questions that are different 
from each other and of the right degree of difficulty. 

Maintain a pattern of difficulty. Present the material 
in each part of the test so that the questions gradually 
increase in difficulty. 

Test one thing at a time. The responses we ask for are 
often very complicated; accuracy of measurement will be 
directly related to our success in holding all the variables 
constant save one and carefully noting its performance. 

Acquaint the student with all the techniques before the 
test. Exaunples should precede all questions requiring 
techniques with which the student may not be familiar 

(Brooks, i960, pp. 166-167). 
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Validity must also be considered. Empirical validity in this situation 
is impossible since there is no outside criterion egainst which to compare 
obtained results. The best alternative is construct validity, which demands 
such careful definition of the required learning task that a skilled teacher 
can determine by inspection and pupil performance if a particular test it - 
is appropriate and if the items collectively represent the total content 



taught a 

To summarize, measuring instruments to evaluate instruction of fifth 
grade students in beginning Spanish were needed. Scarcity of reported work 
in this area necessitated development of these instruments entirely by the 
local staff. The audio-lingual teaching methodology and principles of ‘8 
language evaluation determined these requirements for the instrument: 

1. It should be a test of listening comprehension which could be 

administered via television and scored in the project office. 

a. It should correspond closely to the subject matter taught. All ob- 
jectives of the language instruction should be covered. The necessity for 
employing construct validity meant that careful and detailed definition of 

these objectives was essential. 

3. The test should be in Spanish, with English used only for directions. 

4. No reading or writing of Spanish should be employed. 

5. All test items should be in the normal context of Spanish. Isolated 
vocabulary and language elements out of context should not be used. 

6. The test should be reliable, and test items should discriminate. 
Recognition of the importance of speaking skills should be mentioned, 

perhaps. Measurement of oral ability, an entirely different problem from that 
discussed herein, is necessary for complete evaluation and is receiving con- 
siderable attention in the Denver-Stanford Project. Work in this area will be 
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described in a subsequent report. 

2. CONSTRUCTION OF TESTS 
a. Definition of Course Objectives 

As mentioned before, the validity problem made the most careful and exact 
definition of course objectives necessary before test objectives could be 
established. The course objectives which were measureable through a paper- 
euid-pencil listening comprehension test fell into two general groups: voca- 

buxary acquisition and understanding of structure patterns. 

Concerning vocabulary, Huebener says that the learning of a stock of 
words and expressions is essential to the proper functioning of linguistic 
skills (Huebener, 1959 P» 80). At the same tir-'. experts in elementary level 
language instruction say that vocabulary items must not be taught in isolation 
nor by trainslatioii. "The learning of word lists and the pairing of two lan- 
guages, item by item, must be strictly avoided. Vocabulary must be learned 
in context euid not in lexical form" (Selvi, Briggs, et. al., 1958, p. l6). 

Therefore, though translation and consideration of isolated language 
elements was strictly avoided in the Denver-S tan ford project, pupils were 
expected to acquire a minimum vocabulary. This means understanding the mean- 
ings of individual words, with heavy emphasis on nouns euid verbs at this level, 
and of clusters of words, including idioms, which convey special concepts vyhen 
used together. 

Determination of the specific vocabulary elements used and the emphasis 
given to each was necessary. For this purpose, the content of the television 
lessons was carefully analyzed. Each element was listed according to the 
lesson in which it first appeared and according to subsequent usage. Analysis 
of the first semester's content is shown in Appendix A. 

The second general group of objectives, structure patterns, include such 
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items as article and adjective agreement, verb endings, and word order. As 
with vocabulary, elements were taught in context rather than in isolation; no 
grammatical rules were taught as such but were emphasized through functional 
usage . 

Agreement is probably the structure pattern most difficult for pupils to 
understand, since there is no comparable concept in English. "Agreement of 
adjectives and articles with their nouns is based on the fact that all nouns 
in Spanish are classified as masculine or feminine, a classification which 
often has no reference to the basic meaning of the noun but is an arbitrary 
arrangement" (MacRae, p. l8). Adjectives and articles must agree in number 
as well as gender, of course. Because early understanding of the agreement 
concept is important, it received considerable stress in the TV lessons. 

Verb endings, which depend on tense, number, and person, are easier to 
understand because English usage is similar to Spanish. Spanish verbs, how- 
ever, have many more endings than English verbs, and are thus more difficult. 
The present indicative in Spanish normally has six different endings, for 
example, whereas it normally has only two endings in English. In the TV serioc, 
only the first and third persons, singular and plural, in the present in- 
dicative were used. 

Word order, or syntax, was not heavily stressed since the simple sentences 
taught in the beginning year of instruction used about the same word order as 
would English equivalents. Some emphasis, however, was given to the facts that 
Spanish adjectives often follow their referents and subject pronouns are often 
omitted since verb endings indicate the person acting. 

This statement of course objectives, in general terms and in terms of 
language elements actually used, guided the development and use of test items. 
Its thoroughness made possible the strongest construct validity in test con- 




struction 



b. Construction of the First Semester Mid-term Test 



Fifty items, divided into two 25-item, 15-minute telecasts, were selected 
for the first semester mid-term test. The telecasts were two days apart. A 
two part test was chosen partly through consideration of the attention span of 
the average fifth grader. Also, 50 items were considered a minimum for com- 
prehensiveness, validity, auid reliability. A further reason was to gain some 
of the advauitages of the alternate-forms method of reliability estimation. 
According to Guilford, the reliability coefficient will indicate both internal 
consistency auid stability of performauice when similar test parts are separated 
by a relatively short time (but at least one day). The split-half method alone 
shows only internal consistency and overestimates because of the constancy of 
conditions encountered in a single test period (Guilford, 195^» PP« 373-378) . 

The following ei^t types of items were incorporated into the test: 

1. Sin^e picture items. Here, the pupil had a picture on his answer 
sheet. The instructor gave three statements, and t’ o pupil chose the state- 
ment which correctly described the picture. 

2. Multiple picture items. This type was similar to the first except 
that the pupil had three pictures on the answer sheet auid the instructor gave 
one statement. The first two types of items were meant primarily to test 
extent of vocabulary and some verb usage. 

3 . Article aigreement items. The instructor gave two sentences for each 
item. The sentences were aJ.ike except for the au:‘ticle, which was incorrect in 
one sentence. Pupils had a "1" and a "2" on the answer sheet for each item, 
auid they responded by circling the number for the sentence they thought correct. 

4. Items testing recognition of correct response. The instructor gave 
a sentence which required a response and a second person responded. If the 
response was correct, i.e., was a suitable answer to the sentence, the pupil 
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circled "si" on his answer sheet. Otherwise he circled "no." These items 
were designed to test understanding of simple phrases and idioms such as, 

"Como esta usted?" An appropriate answer would be, "Muy bien, gracias," 
and an inappropriate answer would be, "De nada." 

3 . Simple identification items. A picture was shown on television, 
and the instructor identified it. If the identification was correct, the 
pupil circled "si;" if it was incorrect, the pupil circled "no." 

6. Adjective agreement items. The instructor gave a sentence which 
contained an adjective, and the pupil indicated by circling "si" or "no" 
whether the adjective agreed with the noun it modified. 

7« Word order it^ns. The instructor gave two sentences which con- 
tained the same Spanish words. Word order was correct in one sentence and 
incorrect in the other. The pupil circled a "1" or a "2" to indicate 
whether he thought the first or second sentence was correct. 

8. Verb usage items. Again two sentences were given, and they were 
alike except for the verb form. Only one verb form was correct. The pupil 
indicated his choice by circling a "1" or a "2." 

One hundred and fifty-three test items were constructed and were tested 
first on 200 pupils who saw the televised Spanish series but were not in the 
research project. The biserial correlation coefficient of each item with 
the total score was computed as an index of item discrimination. Fifty items 
were then chosen as a proposed test, with discrimination, range of difficulty, 
complete coverage of subject material, and frequency distribution as the selec 
tion criteria. A mean of 35 correct answers (or 70 per cent) auid a standard 
deviation of five were sought. 

The 30 item form was then tested on ICO pupils as a final check. Again 
biserial correlations were computed. Five items were replaced because they 
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failed to meet the selection criteria. The split-half reliability, with 
Spearman-Brown correction, of the test on this trial was .903i the average 
biserial correlation was + .585i and che average proportion of correct 
answers was .731* 

The test was administered to the 6,CX)0 pupils in the project in December, 
after approximately three months of instruction. The questions suid test form 
are in Appendix B • In the actual administration, the split-half reliability 
with Spearman-Brown correction was .83^, the average biserial correlation was 
+ .439 i and the average proportion of correct answers was .630. The stamdard 
deviation was 7.673* 

In checking all reliabilities, the 50 item tests were randomly divided 
into two 25-item parts. The parts were equivalent, and approximately half of 
each was administered on separate days. The test was slightly speeded since 
pupils were required to respond to each item within a specified time. Gulliksen 
has given this formula to adjust the reliability coefficient for slight speeding: 



M 
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vdiere R = the split-half reliability with Spesurmaui-Brown correction auid 

3C3C 

= the mean number of items unattempted at the end of the test. If all 
items are completed, R^ = R^. The reliabilities reported here for the tests 
developed were therefore not affected by speeding since all items were com- 
pleted (Guilford, 195^ i PP* 391-392). 

Table 1 gives a comparison between the final pre-test and the actual ad- 
ministration of biserial correlations and proportions who passed for each item. 

Sections A and B of the test were given during the first 15-minute tele- 
cast and Sections C, D, E, F, and G were given the second telecast. Though 
the test was generally satisfactory, the need for several improvements be- 
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came apparent. 

Items were numbered by section, as listed in Table 1. This caused some 
confusion since several items had the same number. The obvious solution was 
to number from one to fifty. 

Items with "1" and "2" as a possible response also proved somewhat con^ 
fusing during administration via TV, though they had seemed satisfactory in 
the face-to-face pre-testing. 

Part two of the test had five sections, with the result that as much time 
was required for instructions and examples as for administration of actual 
it^s. Since strict timing was required to give 25 items in 15 minutes, greater 
efficiency would result if the same comprehensiveness could be attained with 
fewer sections. 

Interviews with a few of the pupils after the test showed that they found 
the items with pictures more interesting, and a check on the biserial correla- 
tions reveeQed that this type of item discriminated better than the others. 

The items with pictures on the test form (Sections A amd C) had an average 
biserial correlation of -492, whereas the other items had am average of .372. 

It warn determined that verb usaige, article agreement, adjective agreement, amd 
word order, in addition to simple identification, could be tested with the pic- 
ture-type item. Elimination of several different item types and increased 
discrimination seemed possible through use of more picture items. 

c. Construction of the First Semester Final 

The first semester final tested content from the complete semester, i.e., 
it included the subject matter covered in the first test plus that covered in 
the second part of the semester. The 24 best discriminating items from the 
mid-term were included, amd 26 new items were constructed. 

Based on the results of the first test, the number of picture items was 
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BISERIAL CORRELATIONS OF AND PROPORTION WHO PASSED EACH ITEM 
ON THE FINAL PRE-TEST AND THE ACTUAL ADMINISTRATION — FIRST SEMESTER MID-TERM 
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increased. The new items were chosen in much the same way as before. Seventy- 
eight items were pre-tested on 125 pupils, and 26 items were selected on the 
basis of discrimination, range of difficulty, coverage of subject material, 
amd frequency distribution. Again a mean of 35 correct answers and a standard 
deviation of five were sought. The average pre-test biserial correlation for 
items selected was + .5^2. 

This test was administered via television in two parts on the last two days 
of the semester. In the actual administration, the average biserial correlation 
was + .5^1 and the split-half reliability coefficient, with Spearman-Brown 
correction, was .899* The average proportion of correct answers was .720. 

A comparison of pre-test and final administration biserial correlations 
cind passing proportions for each item is given in Table 2. Sections A amd B 
were administered during the first telecast, and Sections C, D, and E were 
administered during the second. Sections A, B, and C consisted of items with 
pictures on the test form. Section D consisted of type (6) items, and Section 
E consisted of type (5) items. The test questions and answer form are in 
Appendix C. 

Again the picture items showed better discrimination. The average biserial 
correlation coefficient for picture items was + .570, while that of non-picture 
items was + .471. 

The Pearson product moment correlation coefficient between the first 
semester mid-term and final examinations was .735* 

d. Construction of the Second Semester Final 

Only one test was given during the second semester — a final exam during 
the third week in May, aind it was constructed in the same way as the first 
semester exams. 

Two hundred and thirty items were first prepared and were tried on 115 
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Items used in the first semester mid-term 



pupils. Fifty items were then selected from these with the same criteria as 
before, and the fifty item form was tried on 100 pupils. Several items were 
changed as a result of the second trial. Again, the number of picture items 
was increased. 

In the final pre-test of this exam, the average biserial correlation was 
.526 and the average proportion of correct auiswers w^s . 698 . In the actual 
administration of the test, the average biserial correlation was .520 sind the 
average proportion of correct answers was . 69 ^+. The split-half reliability, 
with Spearmeui-Brown correction, was . 88 I. A comparison of biserial correla- 
tions and proportion of correct answers is given in Table 3* 

Sections A, B, euid C were given during the first 15-minute telecast, and 
Sections D, E, and F during the second telecast. Sections A, B, D, and E con- 
sisted of items with pictures on the test form. Section C consisted of type 
(8) items and Section F consisted of type (6) items. The test form and ques- 
tions are in Appendix D. 

On this test the difference between picture euid non-picture items was even 
more dramatic them before. The average biserial correlation for picture items 
was .570 and that for non-picture items only . 295 * 

Type (8) items test verb agreement by having the pupil circle a "1" or a 
"2" to indicate which of two sentences is correct. As noted earlier, this type 
of item seemed confusing, and the second semoster final showed them definitely 
to be poor discriminators. Table 3 reveals that item 21, the first in Section C, 
had a - .273 biserial correlation, and item 22 had only a + .116. The section 
as a whole had an average of + .I 85 . Though these items seem to work well in 
the face-to-face administration employed in pre-testing, they are evidently con- 
fusing and difficult to understand when administered via TV. 

The Pearson product moment correlation coefficient between the first 
semester final and the second semester final was .756. 
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3. CONCLUSIONS 

Three listening comprehension tests to be administered via TV to fifth 
graders in their first year of Spamish instruction were developed. Recommen- 
dations of experts in modern language teaching and evaluation were followed in 
the development, and content analysis of the televised Spanish instructional 
series was made to assure complete coverage of material presented. Rather ex- 
tensive pre-testing was employed so that satisfactory validity, reliability, 
discrimination, range of difficulty, and frequency distribution of scores 
could be achieved. 

Table 4 briefly summarizes the tests in terms of average biserial correla- 
tion coefficient between each item and total score (the measure of discrimina- 
tion), average proportion of pupils who answered each item correctly, and 
split-half reliability (with Spearmain-Brown correction). 

TABLE 4. 

DISCRIMINATION , DIFFICULTY , 

AND RELIABILITY OF THREE TESTS 



i ; 

Test 


; Average 

! Bi serial 

{ Correlation 
j Coefficient 


Average 
Proportion 
Who Passed 
Each Item 


Reliabilitj 


First Semester Mid-Term] 


1 


o 

VO 

• 

1 


.834 


First Semester Final | 


.540 


.720 


.899 


Second Semester Final I 


1 .520 i 

[ ( 


.694 


.881 



o 



The figures in Table 4 indicate that each test was satisfactory , though 
both finals were slightly better in terms of discrimination and reliability 
than the mid-term. Also, the finals were closer to the desired average grade 





Generally, two types of items were used. The first had pictures on the 
pupil’s answer sheet, and the pupil responded by matching a picture to a 
statement spoken by the television instructor. The second type of item re- 
quired choosing one of two possible alternatives (true or false, 1 or 2) to 
judge a statement or statements spoken by the instructor. In each test the 
picture items had substantially higher average biserial correlation co- 
efficients than did the others. 

The method employed in building these listening comprehension tests, i.e., 
careful and detailed analysis of course content, exact specification of course 
objectives, and extensive pre-testing, seems necessary to develop good measur- 
ing instruments for elementary school foreign language instruction. The ex- 
perience in Denver has shown that, although considerable effort is required, 
good measuring devices can be developed. 
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Lexical 
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1 

Introduced 1 
• 

In Lesson . 


Number of 
Lessons in IVhich 
It was Ihiphasizec 




Lexical 

Item 


i i 

{Introduced 

In Lesson | 
• 1 

\ 


Number of 1 
Lessons in Whicn 
It was Emphasized^ 


NOUNS 




NOUNS 


Adios ^ 


6 


p 




corbata 




5 


agua 1 


37 


2 




cosas 


! 35 


3 


alcoba 


30 1 


4 




Cristobal Colon 


i ’ 


2 


alumna 


‘‘3 I 


2 




cuarto & cuartos 


30 ; 


8 


alumno 


13 I 


7 




cuarto de bano 


! 30 ! 


4 


americano 


23 i 


2 




cuarto del nino 


30 i 


3 


amigas 


1 1 


5 




■cuatro 


i 4 

f 


6 


amiguitos 


32 I 


2 


jcuchara 


35 


2 


amigos 


2 


12 


icuchillo 

t 


35 


2 


Antonio 


3 


3 


jcuello 


18 


2 


arbol 


Christmas 


1 


jcuerpo 


17 


4 


articulos 


24 


3 




idedos 


17 


3 


banco 


41 


2 


1 


!dia 


20 


4 


bandera 


25 


4 


idias 


L 


6 


bano 


38 


3 


( 

1 


idientes 


21 


3 


beisbol 


20 


2 




Idiez 


20 


2 


blusa 


28 


2 


jdormitorio 


37 


2 


boca 


17 


7 


j 


Idos 


4 


9 


brazos 


17 


5 




dulce 


Halloween 


3 


bruja 


Halloween 


3 




escuela 


44 


3 


bubo 


Halloween 


2 




Estados Unidos 


Christmas 


3 


cabell 0 


17 


5 




estufa 


33 


4 


cabeza 


17 


3 


j 


exterior 


30 


3 


cafe 


25 


10 


\ 


:familia 


5 


19 


calaba^ 


Halloween 


2 


i fiestas 


Christmas 


3 


calcetin 


23 


3 




gato 


Halloween 


2 


cama 


37 


4 




iglobo 


45 


2 


camisa 


22 


5 


1 

1 


igorra 


28 


2 


jcandela 


4 


2 




gracias 


1 


9 


jcarabelas 


Columbus 


2 


1 

j 


gusto 


5 


4 


icara 


21 


4 


( 


hija 


8 


10 


jcarne 


11 


2 

1 


i 

1 j 


jhijo 1 


8 


11 


casa 


30 


7 


i 


interior 


! 30 


2 


Catalina 


6 


2 


1 

i 


1 ^ 

Jose 1 


i 11 


3 


Icero 


45 


2 i 


\ 

\ 


joven 


1 2 


7 


jchili 


26 


3 




juego I 


20 


4 


jchocolate 


35 


3 




lapiz^ ! 


! 20 


2 


jcientos 


21 


2 




leccion j 


i ? 


9 


jcinco 


4 


5 1 


i 

i 


lechuga 


■ 26 


3 


jcinto 


23 


3 


1 

i : 
1 : 


libro i 


1 1 


3 


jclase 


1 


9 ’ 


1 


Lupe i 


i 3 


2 


jcocina 


30 


6 i 


i 


madre 


8 


2 


Jcolor 


25 


4 

1 


1 \ 
1 


mama 


8 


14 


comedor 


30 


6 




manos 


17 


8 


comida 


11 


5 




manzana 


27 


2 


conversacion 


36 


4 




mauiana 


3 


6 


• 


! 






Maria 


8 


4 I 

1 
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II 



li 



y 



t 
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Item 



nascara 

mesa 

nesita 



nexxcano 

Domento 

muchachas 

muchachos 

muebles 

nada 

naciiniento 



nariz 

Navidad 



Introduced 
In Lesson 



{Number of 
iLessons in Which I 



jlt was Eh^hasizecj 



NOUNS 



nene 



nxna 

ni^to 



nino 

ninos 

noche 



nueve 

numero 



ocho 



030s 

ordenes 



orejas 

padre 

pantalones 

pan 

papa 

papel 

partes 

patio 

pelo 

Pepe 

permiso 

personas 

piano 

piemas 

pies 

pizarra 

platito 

plato 

por favor 

profesor 

profesora 

puerta 

recamara 

refrigerador 

regal o 

ropa 

saco 

sala 



Halloween 

33 

31 

cZ 

4 

39 

39 

4l 

11 

Christmas 

17 

Christmas 

10 

8 

5 
8 

20 

4 

20 

5 

20 

17 

31 

18 

8 

23 
11 
8 
27 
17 

32 

17 
11 

4 

10 

4l 

18 
18 
44 

3^ 

34 
1 
1 

14 

30 

30 

30 

Christmas 

22 

24 

6 



“ 

Lji. 



er|c 



2 

4 

5 

2 

3 

2 

2 

2 

3 

2 

5 

2 

7 

3 

2 

6 
6 

4 

2 

3 

2 

6 

3 

4 

3 
6 
2 

16 

2 

4 
2 
6 
2 
2 
6 
2 
4 



3 

3 

2 

5 

12 

9 

2 

2 

3 

3 

2 

6 

3 

10 
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NOUNS 


1 f 

iseis 


20 


4 


eenor 


2 


11 


jsenora 


4 


7 


jsenorita 


2 


11 


iservilleta 


35 


4 


Isilla 


31 


6 


Isobretodo 


24 


3 


{sofa 


31 


4 


sombrero 


22 


7 


sopa 


35 


2 


tarde 


3 


7 


taza 


34 


5 


telefono 


36 


4 


television 


13 


8 


tenedor 


35 


3 


tiza 


44 


3 


toalla 


39 


2 


tocador 


38 


3 


todos 


3 


6 i 


traje 


27 


4 


tres 


4 


7 


uno 


4 


6 


vaso 


35 


4 


ventana 


30 


5 


vestido 


24 


4 


vez 


3 


5 


vista 


2 


4 


vocabulario 


45 


2 


voz 


2 


2 


zapato 


23 


4 


VERBS 


abra 


29 


3 


abran 


29 


2 


abrir 


29 


2 


{abro 


18 


4 


japarece 

japunte 


20 

2 


2 

3 


•apunten 


6 


2 


ibailar 


Christmas 


2 


bebe 


10 


3 


beben 


35 


3 


bebo 


35 


4 


1 can tan 


Christmas 


2 


jean tar 


Christmas 


2 


jeerramos 


29 


2 


Icerrar 


29 


2 


j cierra 


29 


2 


•cierran 


29 


2 
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11 
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VERBS 




VERBS 




cierro 


18 


5 


,4 


habla 


7 


4 


come 


17 


3 




hablamos 


7 


2 


comemos 


42 


2 




hablan 


7 


2 


comen 


Christmas 


3 




hablando 


20 

1 


2 


ccmier 


42 


2 




hablar 


2 


4 


comiendo 


11 


5 




hablais 


20 


2 


como 


1 


18 




hablo 


7 


5 


comprenden 


2 


2 




hace 


42 


2 


con tar 


22 


2 




hacemos 


42 


2 


decimos 


42 


2 




hacen 


42 


2 


decir 


42 


2 




hacer 


20 


3 


deme 


20 


4 




haciendo 


11 


3 


desea 


42 


3 




hago 


42 


2 


deseamos 


42 


3 




hay 


9 


11 


desean 


42 


3 




ir 


16 


2 


desear 


42 


2 




juega 


29 


2 


deseo 


24 


4 




juegan 


20 


3 


dice 


4 


5 




j'.fgaunos 


29 


2 


dicen 


42 


2 




jugar 


21 


3 


digame 


6 


4 


1 


lavo 


38 


3 


digo 


42 


2 




levauita 


16 


2 


dormir 


42 


2 




levantamos 


16 


2 


dormimos 


42 


2 




levantan 


16 


2 


duerme 


20 


3 




levauitaur 


16 


2 


duermen 


42 


2 




levaoiten 


43 


2 


duermo 


30 


3 




levaoi tense 


43 


2 


durmiendo 


20 


2 




levant ese 


2 


4 


tntra 


29 


2 




levainto 


16 


4 


entramos 


29 


2 




llama 


2 


11 


entran 


29 


2 




mira 


13 


5 


entrar 


29 


2 




mirauDos 


16 


2 


• entre 


30 


2 




miran 


16 


2 


entro 


29 


2 




miramdo 


13 


6 


es 


1 


44 




mirar 


16 


2 


escribir 


20 


2 




miro 


13 


6 


escribo 


44 


3 




pasa 


29 


2 


escuche 


1 


3 




paisamos 


29 


2 


escuchen 


1 


3 




paisaui 


29 


2 


esta 


1 


39 




pasar 


29 


4 


estamos 


16 


X 




pase 


4 


4 


estan 


2 


16 




pasen 


4 


5 


estaur 


16 


2 




paso 


29 


2 


estas 


17 


5 




peino 


18 


4 


estoy 


2 


7 




pintar 


41 


2 


estudia 


42 


2 




pone 


23 


4 


estudiamos 


42 


2 




ponemos 


29 


2 


estudiam 


18 


3 




ponen 


29 


2 


estudio 


42 


2 




poner 


29 


2 








tpongan 


35 
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22 

1 
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29 


2 


qui tamos 
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2 
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29 


2 
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22 


4 
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6 


2 
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1 


3 
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1 


6 
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38 


3 


sentado 


33 


2 
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16 


2 


sentar 


16 


2 
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16 


2 
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16 


3 
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16 


3 


sience 


20 


2 


sientese 


2 


5 


siento 
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5 
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16 


4 
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8 


15 
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2 


9 


tenemos 


15 


4 
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42 


2 


tengo 


19 


21 
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18 


14 


tienen 


39 


4 


toca 


29 


2 


tocamos 


29 


2 


tocan 


29 


2 


tocar 


29 


2 


toco 


29 


3 


trabaja 


33 


2 


usa 


23 


1 


usamos 


42 


2 i 

1 


usan 


42 


2 


usar 


42 


2 


uso 


23 


3 


va 


l6 


2 = 


vamos 


2 


13 


Ivan 


16 


2 ! 


vas 


20 
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ve 


16 
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vemos 


16 


2 i 


ven 


16 
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venga 


6 
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jvengo 


16 
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ivenimos 


16 
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\ 


ivenir 


16 


2 


iveo 


16 


3 


Iver 


2 
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laqui 
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\ 
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16 


3 
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32 


2 
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25 


2 
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30 


3 
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32 


2 
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30 
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16 
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PRONOUNS 



me j 


2 


11 


r. j 


3 


23 


f_r 

ma 


12 


2 


jmis 


5 


6 


que^ 


6 


12 


quien 


3 


11 


quienes 


10 


3 


se 


3 


15 


su 


'4 


10 


1 

sus j 


i 


4 


suya 1 


1 17 




tu 


1 20 


2 


usted 


1 


20 


•iustedes 
» 


1 

? . 


10 

36 



ADVERBS 



6 

14 

4 

1 

2 

1 

10 

1 

45 

3 

4 

7 

1 

a 

44 
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2 
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1 

] 
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1 
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25 


5 
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38 


2 


bianco 


25 


4 


bonito 


24 


4 


bueno 


1 


9 


cien 


1 


2 
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35 


2 
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2 ! 


3 


este 


1 : 


36 


estos 
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7 


extranos 


Halloween ■ 


2 


fea 
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2 


femenino 


8 


2 


grande 


19 


11 


inteligente 


7 


3 


interesante 


20 


2 


larga 


18 

j 


2 

i 
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Christmas ' 
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Undo 


Christmas 


2 
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44 


3 


pasculino 


8 


2 


pucho 


5 


5 
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40 


2 
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25 


6 
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45 


2 


jotra 
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5 


Ipequena 
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• 
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THE FIRST SEMESTER MID-TERM TEST 




HABLO ESPANOL ^ 
LEVEL I SPANISH TEST 
TEST NUMBER ONE 

Part I 



In Section A I will make three statements about each picture. One statement, 
and only one, will be the correct statement for that picture. You will mark 
your answer by drawing a circle around the "A", "B", or "C", whichever you be- 
lieve to be the correct answer. 

Look at the picture for Example 0 and listen carefully to all three statements. 

A. El hijo se pone la camisa. 

B. La hija se pone la blusa. 

C. Ninguno — ninguno means neither. 

I'll read them once more. 

A. El hijo se pone la camisa. 

B. La hija se pone la blusa. 

C. Ninguno — (remember that ninguno means neither). 

Now circle the "A", the "B", or the "C", whichever you think best describes the 

picture That's right, "B" is correct (La hija se pone la blusa) for Example 0. 

Remember, if "A" or "B" does not describe the picture, you will circle the "C" 
to show that neither statement "A" or "B" was correct. 

Listen carefully! I will say each statement twice. 

(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 

(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 
(C) Ninguno 



Number 1 


(a) Es el dedo. 


(B) Son los dedos. 


Number 2 


(A) Son las manos. 


(B) Es la mano. 


Number 3 


(A) Es un nino. 


(B) Es una nina. 


Number 4 


(a) La madre usa un 
sombrero blsinco. 


(B) La madre usa un 
sombrero negro. 


Number 5 


(A) Es un cinto. 


(B) Es un vestido. 


Number 6 


(a) Pepe mira la television. 


(B) Pepe come. 


Number 7 


(a) Es la cabeza. 


(B) Es la cara. 


Number 8 


(A) La clase levanta las manos. 


(B) La clase estudia 


Number 9 


(A) El pie es grande. 


(B) La pierna es gra: 



Number 10 (A) Es una senorita. 
Number 11 (A) Es una falda. 

Nuobtr 12 (A) El nene abre los ojos. 
Number 13 (A) La camisa es blanca. 
Number 1^ (A) Es una camisa. 

Number 15 (A) Tienc una mono. 



(B) Es una senora. 

(B) Es una corbata. 

(B) El nene juega. 

(B) La blusa os negra. 
(B) Es una corbata. 

(B) Tiene dos manos. 
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J 



Number l6 (A) La senorita habla. 



(B) La senorita se viste. (C) Ninguno 



Now let's look at Section B. 

In this section I will say each statement twice » If the statement is correct , 
(good Spanish) circle the "s£." If it is incorrect, (poor Spanish) circle "no.” 
Let's do Example 0 of Section B together. "Esta es la madre." Si o no? Si, the 
statement was correct. If I had said "Esta es el madre," it would have been 
wrong, wouldn't it? So for Example 0 you should have circled "si because the 
statement was correct (or good Spanish). Now let's do Section B. Listen care- 
fully, I will say each statement twice ! 

Number 1. Esta es la profesora. 

Esta es el senora. 

Esta es el nina. 

Esta es la padre. 

Esta es 3.a cara. 

Este es el amigo. 

Este es el blusa. 

Estos son los calcetines. 



Number 2. 
Number 5* 
Number 4. 
Number 5* 
Number 6. 
Number 7* 
Number 8. 



PART II 

In Section C I will read a sentence and you must decide which of the three 
pictures the sentence describes. Remember, the sentence must describe what you 
can actually see in the picture. 

Let's do Example 0 together. Look at the pictures next to Example 0 at the top 
of the page. "A" shows a little girl wearing a dress. "B" shows a woman wearing 
a dress. ”C" shows a little girl wearing a skirt and blouse. Now listen to the 

sentence: 

"La nina usa una blusa y una falda." 

Which picture does the sentence describe? 

Si, picture "C" is correct — the picture of a girl wearing a blouse and skirt. 
Each of you should have circled the "C". If you didn't have it circled, circle 

the "C" in Example 0 now. 

Listen carefully! I will read each statement twice . 

Number 1. La nina tiene una blusa en la mano. 

Number 2. La camisa es blanca. 



I o 

r 
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Number 3* 
Number 4. 
Number 5« 
Number 6. 
Number ?. 
Number 8. 
Niimber 9» 
Number 10. 
Number 11. 
Number 12. 



Juan abre la ventan''.. 

El joven y sus amigos estan en la clase. 
El nine tiene dos orejas. 

El joven levanta los brazos. 

La familia esta comiendo. 

El nene cierra los ojos. 

EL nino tiene dos piernas. 

La nina cierra la puerta. 

Hablamos con la boca. 

Maria usa una blusa. 



Now turn to page 3 and find Section D. 

In this section I will say a sentence that requires a response, and then I will 
give a response. You must then decide if the statement or answer I gave in 
response is correct. 

Now here's Example 0 of Section D to give you the idea. 



"iComo esta usted?” "Asi, asi." 

Is "Asi, asi" a correct answer for "iComo esta usted?" Yes, so you wou3.d circle 
the si in Example 0. 

Now let's complete Section D. Listen carefully I will say each statement 

twice. 



Number 1. 
Number 2. 
Number 3* 
Number 4. 
Number 5» 



Cierre la puerta. 
oComo esta la feimilia? 

Ud. habla espanol muy bien. 

Levantese Ud. 

iComo se llama usted? 



Abro la ventana. 

Muy bien, gracias. 
Gracias, Juan. 

Me levanto. 

Bien gracias y usted? 



Now find Section E in the upper right hand quarter of the page. 

In Section E I will show you a picture and will say a sentence in Spanish. If 
what I say tells what is in the picture, circle "si." If it does not tell what 
is in the picture, circle "no." 

Let's do Example 0 together (Hold up picture of clothing). "Estos son artlculos 
de ropa." si or no? Yes, the picture shows "artlculos de ropa" so you should 
circle the si in Example 0. I will say each sentence twice ; Look at the 
picture carefully. 



o 
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Number 1. Esta es la profesora. (Picture of male professor) 

Number 2. Este es un cinto. (Picture of tie) 

Number 3* Esta es una blusa. (Picture of a shirt) 

Number 4. Esta es la cabeza. (Picture of an arm) 

Now let's look at Section F in the lower left hand part of the page. In this 
section I will make two statements, one statement will be right and one will be 
wrong. If the first sounds right to you, circle the number one. If the second 
one sounds right, circle the number two. 

Here is Example 0: 

Statement 1 "La nina como." Statement 2 "La nina come." 

Which of these sounds correct? Right, the second one, "La nina come," so you 
should circle the 2 in Example 0. 

In this section I will not repeat I will say each statement once only. 

Statement 1 La nina se llama Maria. Statement 2 La nina me llamo Maria. 



Statement 1 Pepe se visten. 



Statement 2 Pepe se viste, 



Now let's look at Section G, the last part of the test. In section G I will give 
you a sentence and you are to determine if the sentence is correct or if it has 
a word with a wrong ending. If it is correct as given, mark "si", but if the 
sentence is not given correctly, mark "no." 

Let's do Example 0 in section G. "La casa es pardo." si or no? No, pardo should 
have been parda, so since an ending was wrong you mark "No" to show the mistake. 
Listen carefully, I will say each sentence twice . 



Number 1. La camisa es bianco. 
Number 2. El vestido es azul. 
Number 3» La falda es rojo. 
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si 


No 




1. 


Si 


No 




2. 


Si 


No 




2. 


Si 


No 




3. 


Si 


No 




3. 


Si 


No 




4. 


Si 


No 




4. 


si 


No 




5. 


Si 


No 
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HABLO ESPANOL 
LEVEL I SPANISH TEST 
TEST NUMBER TWO 

Paurt I 

In S©ction A I will inakG thr©© statsinents about each picture* One statement, and 
only one, will be the correct statement lor that picture* You will mark your 
answer by drawing a circle around the "A" , ”B" , or "C" , whichever you believe to 
be the correct answer* Let's work Example 0 (at the top of the page) together* 

Look at the picture for Example 0 and listen carefully to all three statements* 

A* El padre come* 

B* La madre come* 

C* Ninguno — ninguno means neither 

I'll read them once more* 

A* El padre come* 

B* La madre come* 

C* Ninguno — (remember that ninguno means neither) 

Now circle the "A", the "B", or the "C", whichever you think best describes the 

picture that's right, "A" is correct (EL padre come) for Example 0* Remember, 

if "A" or "B" does not describe the picture, you will circle the "C" to show that 
neither statement "A" or "B" was correct* 

Listen ceurefully, I will say each statement twice* 

Section A* 



1* a* 


La mano tiene cinco dedos* 


b* 


La mano tiene dos dedos* 


c* 


Ninguno* 


2 * a* 


Es la nariz* 


b* 


Es la boca* 


c* 


Ninguno * 


3. a* 


La madre usa un sombrero bianco* 


b* 


La madre usa un sombrero negro* 


c* 


Ninguno* 


4* a* 


Es UU 3 camisa* 


b* 


Es una corbata* 


c* 


Ninguno* 



5 . 



6 . 



7 . 



8 . 



9 . 



10 . 



11 . 



12 . 



a. £s un nino. 

b. Es ima nina. 

c. Ninguno. 

a. Es una falda^ 

b. Es ima. corbata. 

c. Ninguno. 

a. Es un cinto. 

b. Es un vestido. 

c. Ninguno. 

a. El pie es grande. 

b. La pierna es grande. 

c. Ninguno. 

a. La camisa es blanca. 

b. La blusa es negra. 

c. Ninguno. 

a. La senorita habla. 

b. La senorita se viste. 

c. Ninguno. 

a. Es una senorita. 

b. Es una senora. 

c. Ninguno. 

a. Es el dedo. 

b. Son los dedos. 

c. Ninguno. 



Now look at Section B. In Section B I will read a sentence and you must decide 
which of the three pictures the sentence describes. Remember, the sentence must 
describe what you can actually see in the picture. 

Let's do Example 0 together. Look at the picture next to Example 0 nerjr the top 
of page 2. "A” shows a family of five. "B” shows five boys talking together. 

"C” shows five girls talking together. Now listen to this sentence; "En esta 
familia hay cinco personas." Which picture does the sentence describe? Yes, 
picture "A" is correct — the picture of a family of five. 

Listen carefully, I will read each statement twice! 
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Section B. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20 . 
21 . 
22 . 

23. 

24. 

25. 



La nina usa una blusa y una falda. 
Las zapatos son negros. 

El padre se pone zapatos. 

El hi jo estudia. 

La familia esta cotniendo. 

La camisa es blanca. 

El joven levanta los brazos. 

La nina tiene una blusa en la mano. 
El nino tiene dos orejas. 

Habla con la boca. 

El nino tiene dos piernas. 

Juan abre la ventana. 

Maria usa una blusa. 



PART II 



In Section C I vdll read a sentence and you must decide which of the four pictures 
the sentence describes. Remember, the sentence must describe what you can 
actually see in the picture. 

Let's do Example 0 of Section C together. Look at the picture next to Example 0 
at the top of the page. "A" shows a boy using a knife. "B" shows a boy using a 
fork. "C" shows a boy using a spoon, and "D" shows him wiping his mouth with a 

napkin. 

Now listen to the sentence: "El nino usa una cuchara." 

Which picture does the sentence describe? 

Yes, picture "C" is correct ~ the picture of a boy using a spoon. 

Listen carefully, I will read each statement twice! 

Section C. 

26. Hay una mesa y seis sillas en este cuarto. 

27. La familia esta en la sala. 

28. El nino habla por telefono con su amigo. 

29. El nino usa un vaso para beber. 

30. En este cuarto duermo. 

31. En este cuarto come la familia. 

32. La madre se lava las manos en la cocina. 

33. La madre cierra la ventana. 

ERIC 
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3^* La nina se lava la cara. 

35* El nene tiene un cuchillo en la wano. 

Now look at Section D. I will say each statement tv;ico. If the statement is 
correct (good Spanish)* circle the "si«" If it is incorrect (poor Spanish)* 
circle the "no." 

Let's do Example 0 of Section D together. "Esta es el cabeza." Si o no? No, 
the statement is not correct. If I had said "Esta es la cabeza" it would have 
been correct* wouldn't it? 

Now let's do Section D together. Listen carefully* I wilVsay each statement twice. 



Section D. 

36 . Este es el hi jo. 

37* Esta es la silla. 

38 . Esta es la servilleta. 

39* Esta es el cuchara. 

40. Este es el vaso. 

41. Este es la comedor. 

42. Hablamos con el boca. 

43 . Esta es la cara. 

44. Este es el blusa. 






SI 


no 


si 


no 


si 


no 


si 


no 


si 


no 


si 


no 


si 


no 


si 


no 


si 


no 



Now look at Section E ~ the last section of the test. 

In this section I will show you a picture and will say a sentence in Spanish. If 
what I say tells what is in the picture* circle "si." If it does not tell what 
is in the picture* circle "no." 

Let's do Example 0 together. (Hold up a picture of a spoon.) 

"Esta es un tenedor." Si o no? No, the picture shows una cuchara, no un tenedor, 
so you should circle "no" for Example 0. I will say each sentence twice. Look 
at each picture carefully. 

Section E. 

45 • Esta 

46. Esta 

47 . Este 

48 . Esta 
49 * Esta 
50 . Esta 



es la cabeza. (Picture of 
es una blusa. (Picture of 
cuairto es la sala. (Picture of 
es una puerta. (Picture of 
es una mesita. (Picture of 
es la profesora. (Picture of 






arm) 


si 


no 


skirt) 


si 


no 


living room) 


si 


no 


door) 


si 


no 


a night table) 


si 


no 


male professor) 


si 


no 
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40. 


sf 


No 


36. 


si: 


No 


41. 


sf 


No 


37. 


s^ 


No 


42. 


sf 


No 


38. 


sf 


No 


43. 


sf 


No 


39. 


sf 


No 


44. 


sf 


No 








Section E 






Example 0. 


sf 


No 








45. 


sf 


No 


48. 


sf 


No 


46. 


sf 


No 


49. 


sf 


No 


47. 


sf 


No 


50. 


sf 


No 
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HABLO ESPANOL 
LEVEL I SPANISH TEST 
TEST NUMBER THREE 

Part I 

In Section A I will read a sentence and you must decide which of the three pic- 
tures the sentence describes. Remember, the sentence must describe what you csui 
actually see in the picture. 

Look at the pictures next to Example 0. "A" shows 12:15* "B" shows 12:45. "C" 

shows 2:15* Now listen to this sentence: "Son las doce y quince." Which pic- 

ture does the sentence describe? Yes, picture "A" is correct — the picture 
showing 12:15* Each of you should have circled the "A." If you don't have "A" 
circled, circle the "A" in Example 0 now. 

Listen carefully! I will read each statement twice ! 

Section A. 

1. La nina va a la escuela. 

2. Todos los alumnos escriben. 

5* Los hijos tomeui leche para el desayuno. 

4. Mama compra comida paura el desayuno. 

5* La mama prepara la comida. 

6. La mamia tiene una botella. 

7* Los ninos van a la escuela. 

In Section B I will read a sentence and you must decide which of the four pic- 
tures the sentence describes. Remember, the sentence must describe vdiat you 
can actually see in the picture. 

Look at the pictures next to Exaunple 0. "A" shows a boy and a girl playing %fith 
a ball. "B" shows a boy playing with a ball and a girl Jumping rope. "C" .^hows 
a boy auid a girl reading, and "D" shows a baby playing with blocks. Now listen 
to the sentence: "Los alumnos juegan con una pelota." ’/hich picture does the 

sentence describe? Yes, picture "A" is correct — the picture of a boy and a 
girl playing with a ball. Each of you should have circled the "A." If you 
don't have it circled, circle the "A" in Example 0 now. 

Listen carefully! I will read each statement twice ! 
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Section B. 

8. EL nino escribe en el papel con im lapiz. 

9* Papa compra ina ceunisa pequena para su hijo. 

10. La mama sirve cau:iie. 

11* La mama y los ninos prepeurem el almuerzo. 

12. La familia esta comiendo en la cocina. 

13* La nina mira a iin calendario. 

14. EL vendedor vende ropa. 

15 . Compra una botella de leche. 

16 • La familia esta cenando en el comedor. 

17* ELla tiene una falda corta. 

18 . Son las tres y media. 

19* Es la primavera y hace buen tiempo. 

20. EL papa compra una corbata y una camisa. 

Now look at Section C. In this section I ani going to read two statements - one 
statement is correct, the other one is incorrect. Remember, one statement will 
be right, one will be wrong. If the first one sounds right to you circle 
number one. If the second one sounds right circle number two. 

Listen to the two sentences for Example 0. Number 1: ”La al nmna lee.** Number 2.1 

"La alumna leen.** Which statement is correct? Yes, number 1. "La ai iimna lee.** 
Circle number 1. 

Listen caurcfully for I will say each statement only once . 

Section C. 

21. 1 Las naranjas esta en la tienda. 

2 Las naranjas estan en la tienda. 

22. 1 La ropa es beurata. 

2 La ropa es barato. 

23 . 1 EL alumno escribe en la pizeurra. 

2 EL alumno oscribimos en la pizarra. 

24. 1 EL padre usa el azucEur. 

2 EL padre usamos el azucau:. 

23. 1 Nuchas personas compra ropa. 

2 Muchas personas compran ropa. 
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Part II 



In Section D I will read a sentence and you must decide which of the three pic- 
tures the sentence describes. Remember, the sentence must describe what you can 
actually see in the picture. 

Look at the picture next to Example 0. "A" shows a boy playing with a ball and 
a girl jumping rope. "B" shows a girl looking at a boy holding a book on his 
head. "C" shows boys playing basketball. Now listen to this sentence: "Los 

ninos juegan juegos." Vihich picture does the sentence describe? Yes, picture 
"A" is correct — the picture showing the children playing two separate games. 
Each of you should have circled the "A." If you don't have "A" circled, circle 
the "A" in Exaimple 0 now. 

Listen carefully! I will read each statement twice ! 

Section D. 



26. 


Los ninos cantan canciones. 


27. 


La escuela tiene muchas 


ventEUias . 


28. 


La mama compra ropa. 




29. 


Ponen platos solamente. 




30. 


El nino esta contento. 




31. 


Los cdumnos sailen de la 


escuela. 


32. 


Las ninas dein regcdos. 





In Section E I will make three statements about each picture. One statement, and 
only one, will be the correct statement for that picture. You will mark your 
answer by drawing a circle around the "A", "B", or "C", whichever you believe 
to be the correct answer. 

Look at the picture for Example 0 and listen carefully to all three statements. 

A. Es un alumno. 

... B. Es una cilumna. 

C. Ninguno (ninguno means neither). 

I'll read them once more. 

A. Es un alumno. 

B. Es una alumna. 

C. Ninguno (remember that ninguno means neither). 

Nov; circle the "A", the "B", or the "C", whichever you think best describes the 
picture ... that's right, "B" is correct ("Es una alumna") for Example 0. 
Remember, if "A" or "B" does not describe the picture, you will circle the "C." 
Listen carefully! I will say each statement twice I 
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Section E. 



33. 


A. 


Son libros. 




B. 


Es libro. 




C. 


Ninguno. 


34. 


A. 


Es una ventana. 




B. 


Es una semana. 




C. 


Ninguno . 


35. 


A. 


El gato es bianco. 




B. 


El plato es bleinco. 




C. 


Ninguno. 


36. 


A. 


El globo esta en la mesa. 




B. 


La bander a esta en la mesa. 




C. 


Ninguno . 


37. 


A. 


Es el numero veinte y uno. 




B. 


Es un numero. 




C. 


Ninguno. 


38. 


A. 


Son las ventanas. 




B. 


Son lais puertas. 




C. 


Ninguno . 


39. 


A. 


Escribe en el papel. 




B. 


Escribe en la pizarra. 




C. 


Ninguno. 


40 . 


A. 


Es nueve. 




B. 


Es jueves. 




C. 


Ninguno. 


4 l. 


A. 


Es jueves. 




B. 


Son huevos. 




C. 


Ninguno . 


42 . 


A. 


Es jugo de tomate. 




B. 


Es jugo de naranja. 




C. 


Ninguno . 


43. 


A. 


La taza es blanca. 




B. 


La tiza es blanca. 




C. 


Ninguno. 


44 . 


A. 


Es la bandera. 




B. 


Es la primavera. 




C. 


Ninguno . 



o 
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45 . 

46 . 



A. Es un veinte. 

B. Race viento. 

C. Ninguno. 

A. Race fresco. 

B. Es un refresco. 

C . Ninguno . 



In Section F, I will say each statement twice. If the statement is correct 
(good Spanish), circle the "Si." If it is incorrect (poor Spanish), circle 
the "No." 

Let's do Example 0 of Section F together. "Esta es ^ escuela." Si o no? No, 
the statement is not correct. If I had said "Esta es ^ escuela" it would 
have been correct. 

So, for Example 0 of Section F you should have "No" circled. If you don't 
have "No" circled, do it now. 



Section F. 



47. 


Esta es el 


sala de clase. 


si 


No 


• 

00 


Es la estacion de vacaciones. 


si 


No 


49. 


Las padres 


compran ropa. 


si 


No 


50. 


Los huevos 


son blancos. 


si 


No 
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SUMMARY 



The Problem 



First year pupils in the Denver-Stanford project study Spanish by 
the audio-lingual method. During their second year of instruction, 
howe'^ er, they learn to read and write the vocabulary and functional 
grammar used orally the first year. 

If programed materials could be developed that would teach 
reading and writing as well as or better than the conventional teacher 
directed approach, the serious shortage of trained teachers and the rc 
suiting administrative scheduling difficulties could be overcome. 



Results 



Both programed and conventional texts were prepared so that a 
comparison could be made. The lack of prior e:q)erience or reported 
results in the area made programing a time consuming and exacting 
process. It meant that trials with a wide variety of pupils were 
necessary. 

The literature related to programing was thoroughly examined, 
and the programer, a language specialist with years of teaching 
experience, very carefully defined the exact objectives to be 
achieved. However, this preparation proved highly inadequate. The 
procedures to be followed could be determined only after many hours 
of work ’(dth pupils. 

This report describes the process of development which evolved 
and gives preliminary results of effectiveness. Large scale trials 
of the programed materials and comparisons with conventional in- 
struction will be conducted during the 1961-62 school year. 

The preliminary results show that pupils learned a significant 
amount from the programed materials. They also suggest that class- 
room factors, independent of the materials and of pupil ability, 
affect the amount learned. 



Development of Programed Learning Materials 
for use vrith Televised Spanish Instruction 



by 

Delbert Barcus 
John L, Hayman, Jr. 
James T. Johnson, Jr. 



The Denver Public Schools and Stanford University's 
Institute for Communication Reseaurch are currently engaged 
in a joint research project on the context of instructionaO. 
television. The purpose of the project is to learn how 
instructional television can best fit into the total teach- 
ing situation. A substauitiaG. amount of research has estab- 
lished that television is a very effective teaching medium. 
Ways of combining it with other educational activities must 
now be considered, auid the Denver-Stanford project is a 
beginning effort in this direction. Kenneth E. Oberholtzer 
is principal investigator for the Denver Public Schools 
and Wilbur Schraunm is principal investigator for Stamford 
University. This is one of a number of project progress 
reports . 



The Denver-Stanford project ib concerned with teaching beginning Spanish 
to some 12,000 fifth and sixth grade pupils. All pupils view televised 
Spanish lessons and engage in teacher-directed classroom activities designed 
to complement the TV lessons. Three half-hotu:* periods per week are devoted 
to Spanish instruction. 

In keeping with current practice in elementary school foreign language 
instruction, audio-lingual practice is used exclusively during the first 
year of study (fifth grade). During the second year (sixth grade) audio- 
lingual skills are taught primarily, but reading and writing are also intro- 
duced. The vocabulary and functional grammar 7’sed in reading and ^'^riting 
are limited to material which is taught audio-lingually in the fifth grade 
and ¥rith which pupils have oral facility. Both programed and conventional 
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texts were developed during the 196O-6I school year for this aspect of 
Spanish instruction# 

Acquisition of reading and writing skills through programed materials 
and through conven\;ional teacher-directed methods will be compared during 
the 1961-62 school year, with some 6,000 sixth graders taking part. Three 
versions of the programed materials will be used. Two of them involve texts 
in which different sequences of frames produce different error rates; the 
third uses the programed materials in a teaching machine. One objective, 
of course, is to learn as much about the use of automated materials as 
possible. But, in keeping with the fundamental purpose of the project, the 
ultimate question to be considered here is, "How can educational television 
and automated instruction be combined to produce optimum learning?" 

This report discusses development of the automated instruction program 
and presents preliminary test results. 

I . Program Development 
a. Determination of Programing Procedures 

A careful study of available information on automated learning was 
made prior to any programing. Especially useful were Eugene Galanter's 

Teacl^: State of tlw Art ('Oi "Teaching Machines: an Anno- 

tated Bibliography" by Edward B. Fry, Glenn L. Bryan, and Joseph W. Bigney (3); 

and T e aching Machines and Programmed Learning by A. A. Lumsdaine and Bober t 
Glaser (5). 

The following general steps for developing the program were then es- 
tablished: 

1. Outline the behavioral outcomes to be achieved. 

2. Analyze the elementary components necessary to achieve such 
behavior. 

3* List the heuristic elements. 

4. Prepare a tentative set of frames on 3 x 5 cards. 
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3« Test the frames on individual sixth graders. 

6. Revise the frames. 

7. Test the frames on groups of pupils. 

These limitations were to be observed: 

1. Translations were to be avoided. 

2. Visuals were to be used, when possible, to establish the 
meaning of words. 

3. Grammatical constructions were to be taught by induction 
rather than by rules. 

4. The program was to be of the linear, error-free type. 

The general beliavioral outcomes to be achieved by the end of the year 
were defined as follows: 

1. The pupil should be able to understand the meaning of written 
Spanish words, sentences, and paragraphs composed of words and 
phrases used audio-lingually in Level I (fifth grade). 

2. The pv^il should be able to write any sentence in Spanish com- 
posed of words and phrases used audio-lingually in Level I. 

Concerning outcome 1, all words are taught in context; consequently the 
piqpils would be eaqpected to recognize the meaning of words in context but 
not necessarily in isolation. Learning words in context is more effective 
than learning words in isolation according to studies by F. M. Hamilton, 

H. Eng, A. Balban, and W. Libby (1, p. 238). 

Declarative, interrogative, exclamatory, and imperative sentences were 
to be understood. The latter two types are extremely limited in Level I, 
however, so eoqphasis was placed on declarative and interroga*' ive patterns. 

Paragraph structure in Level I is very simple. For the most part a 
paragraph at this level consists of only three or four simple sentences and 
is generally a brief description of something concrete or is an answer to a 
question concerning roi^tine, everyday activities. 




Outcome. 2 im p ll e c that a child must be able to spell accurately in 
Spanish; he must use accent marks and tildes correctly; he must be able to 
construct Spanish verbs; and, finally, he must be able to arramge ivordc in 
their syntactically correct order in declarative and interrogative centenc-:j. 
As stated before, these specifications are limited entirely to the con- 
structions presented audio-lingually in the Level I television series. 

b. Determination of Heuristic Elements 

Determination of heuristic elements proceeded concurrently %d.th the 
develo|Mnent of frames. Some elements v;ere Dieted empirically prior to be- 

ginning the program, but these proved quite inr.de qua te as the program de- 

/ 

veloped. Most of the important elements vrere discovered through actual ex- 
perience %rlth the children. 

In developing the vocabiaary for the program, all of the words and 
phrases used in the television lessons the first year vrere arranged alpha- 
betically and a frequency count made. This vocabulary was then checked 
against Dolch's Basic Si^t Vocabulary List and against Keniston's List of 
Spanish Words and Idioms. The words which v/ere most frequent in the tele- 
vision series and which appeared in Dolch's or Keniston's v/ord lists were 
selected for use in the first units of the programed instruction; the lose 
common words would appear later in whe program. A second alphabetical i i -■ 
was made classifying the various parts of speech separately. 

In dealing with graicmar , an a"”bitrary soqucnce based on experience i.v.tx 
traditional text books was set upr As the programer worked with individual 
children, he continually modified the sequence eo that the learner v/as led 
to an understanding of that which follov;ed. /.ll grammar v/as taught function— 
^ normal conversational manner. Grammatical rules, generalizations, 
or nomenclature were never mentioned. Ine sequence of grammatical components 
which finally evolved through this '*v.'ritc and modify" prcjedure was as foijovr .3 



1. General introduction to gender using nino, nina, hemano, heroana. 

2. Introduction to gender of i n a ni mate objects such as sombrero, 
vestidO; blusa, casa. 

3. Use of possessive nouns (de Roberto, de Maria). 

4. Formation of negative declarative sentences with "no" as the only 
negative. 

6Es Roberto una ni^? 

No, no es una ni^. Es un nino. 

5. Agreement of adjectives with singular nouns ending in "o" or "a". 

6. Formation of the plural of noims ending in a vowel. 

7- Indication of first person singular, present indicative, hj verb 

ending "o" and of third person singular, present indicative, by 
endings "e" and "a". 

8. Agreement of singular adjectives ending in letters other «o" 
and "a" with singular nouns. 

9- Formation of the plural of nouns ending in consonants. 

10. Agreement of adjectives with plural nouns. 

U. Indication of third person plural, present indicative, by verb 
endings "en" and "an". 

12. Formation of negative questions with "no" as the only negative. 

"cNo juega al beisbol el nino?" 

13. Use of the subject pronouns yo, el, ella, ellos, ellas. 

14. Indication of first person plural, present indicative, 1:^ the verb 
endings "amos", "emos", and "imos." 

15. Position of descriptive adjectives. 

16. Use of the idioms "va a", "me gusta", and "le gusta." 

17* finployment of the i>ossessive pronouns "mi", "su", "nuestro", "mis", 
"sus", and "nuestros." 
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l8. Placement of accents on "que", **quien”, '•como**, and ”donde'* to 
form interrogatives. 

19* Use of capitalization. 

20. Need for definite articles with titles of address. 

None of the foregoing components required a specific number of frames; 
some were presented adequately in twenty frames, while others took as many 
as sixty. Each component, moreover, marked only the introduction of the 
particular concept and the basic development of it. The concepts were not 
presented as entities. On the contrary, every effort was made to constantly 
reinforce all material previously introduced by frequently presenting it 
in new contexts and by incorporating the old with the new in gradually more 
complex structures. 

As each new component was introduced, new words were incorporated which 
lent themselves to the teaching of the particular grammatical conc^t in- 
volved. The words were still selected, however, in relation to the fre- 
quency count previously mentioned. Some c(»Bponents had only six new words or 
phrases to be used in combination with established vocabulary; others had 
as many as thirty new words. 

A useful device for keeping track of vocabulary entry, re-entry, and 
frequency coun^ was a duplicated alphabetical work sheet on tdiich were 
printed the first fifty words programed. To this list was added each new 
word with the number of the cooqpcnent in vdiich it appeared. After each 
conqponent had been completed and used with individual pupils, a tally was 
made of the number of times the pupils had been required to write each new 
word. It was assumed, since there was no evidence on the matter, that each 
word to be learned should be used actively by the learner at least five 
times. Although there were a few exceptions, this assunq)tion proved to be 
generally sound and was used throughout the program. 
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In addition to developing a se<>uenc^> of vocabulary and a pskttem.. for- 
teaching grammatical concepts, the programer had to determine the kind of 
prompts which could be used effectively. The prompts developed are listed 
below in the order of their effectiveness (with the most effective prompt 
first) . 

1. Bepetition of a key word: 

Margarita tiene una blusa blanca; la blu ^no es negra. 

2. Pictures: 

Hay tres nines y dos . 

3* Limited choice: 

Los dcs hermanos se J ose y Federico. 

4. Parallel construction: 

Rober::o es un ni^ y Maria es una n 
3* Opposites* 

Esta '?asa es fea, no es bo . 

6. Indicating categories: 

EL color de una hoja es . (roja, rojo) 

7* Drawing a conclusion: 

En la familia Smith ha y p ersonas: la madre y el padre. 

8. Use of different tense or number: 

Hay muchas calles en Denver. Un a s e llama Downing. 

9. Physical arrangement: underlining, italics, different colors, 

spatial arrangement arrows, etc. 

Other elements which proved important are listed below. 

1. Words that are spelled alike in both languages but are not related 
in meaming should be given special attention by placing them in a 
context which will prevent, if possible, an erroneous interpretation. 
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2. Use words that are very familiar audio-lingually to teach spelling 
differences: 

a. Once, doce, trece, catorce, quince for final "e's." 

b. Jose, rojo, and hi jo for ”j.” 

c. Amarillo and "c-Como se llama usted?” foi "11." 

d. "Azul" for "z." 

e. "Pequeno" for que and n. 

f. Senor and senorita for n. 

g. '*Hasta la vista", "Hasta manana" and hi jo for "h." 

3 * Questions containing "or" should be given careful attention. "Does 
Mary have a green or yellow dress?" will generally elicit the ansv/er 
"yes" instead of the color. 

4. Call attention to accent marks and tildes. Children will not use 
them automatically. 

c. Development of Individual Frames 

To begin the program, forty-one frames requiring multiple choice re- 
sponses were written on 3 x 5 cards and were used with nine average sixth 
graders. The programer worked individually with the pupils, explaining to 
each the purpose of the work to be done and emphasizing that this was not 
a test but a new way to learn to read and write in Spanish. As a child 
worked throu^ the sequence of frames, the programer kept a record of the 
time required for completion, made notes on incorrect responses, and 
questioned each pupil concerning his responses. 

As each child finished, the program was revised by adding or deleting 
frames; underlining key words; adding pictures, circles, and/or arrows; or 
by changing the wording. Then the revised set of frames was used with another 
I individual. This process was continued until the nine pupils had worked 

I through the program. By this time, the 4l frames had increased to 10?. The 

time required for completion of the sequence shows the simplification that 
occurred; the first child had spent thirty minutes on 4l frames while the 

I ^ 

. ERIC 
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last child spent only forty minutes on 10? frames. 

Many technical faults of the program were discovered immediately and 

were immediately remedied. This reduced the error-rate somewhat. It soon 
became apparent, however, that a change in general outlook was necessary for 
further improvement. It had been assumed that the pupils would know about 
the same words and grammatical concepts, since all had similar e 3 q>osure to 
televised lessons and classroom practice. This proved false. Errors, ex- 
cept those caused by faulty prompts, did not fall into a consistent pattern, 
indicating a lack of uniformity in the Spanish background of the children. 

It seemed necessary, therefore, to treat practically every word as a new 
item to be taught and to keep learning steps between frames quite small. 

A change was also made in mode of response. During the first nine 
trials, multiple choice was the mode employed. During the next nine trials, 
however, constructed response was used and fewer errors occurred. This 
change is consistent with findings of Edward B. Fry in a study at the Uni- 
versity of Southern California (2). Fry compared constructed and multiple 
choice response in teaching Spanish vocabulary to English-speaking ninth 
grade students. He found that, if recall was the learning criterion, con- 
structed response was superior. Because recall as well as recognition is 
a desired behavioral outcome of the Denver-Stanford project, and because of 
the lower error rate, the remainder of the program was written entirely with 
the constructed response mode. 

A further improvement was made by adding panels which showed pictures 
identified by Spanish words. Pupils were encouraged to refer to these panels 
at any time. Prior to this decision, two other prompting methods were tried. 
In the first, brief information panels were interspersed with the frames. 

Each panel was to be studied before continuing on to the next frame and could 
not be used for further reference. In the second method, the learner studied 
a panel containing all the difficult vocabulary before beginning the program 
and he could not later refer back to the panel. These two methods proved 
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ineffective, while allowing the learner to have the panel before him with- 
out restriction reduced the error rate considerably. Also, a short quiz 
given at the end of each trial indicated that more learning occurred when 
the panel was used continuously. 

d. Trials with Larger Groups 

Upon completion of thirty-one individual trials the preliminary unit 
seemed to be relatively error free and educationally sound. The next step 
was to use the program with a group of children in a regular classroom 
situation. 

The first fifty-three frames, which took the average child twenty-five 
minutes to complete, were duplicated and stapled in a programed text (panel 
book) form. The sequence was used with a class of thirteen children, all 
of whom had viewed the Level I televised Spanish series the year before* 
Eleven children finished and two did not. The number of errors, given in 
Table I, gave an overall error rate of .05^- 



NUMBER OF ERRORS IN A CLASSROOM TRIAL OF THE FIRST 53 FRAMES 



NUMBER OF PUPILS 
k 

3 

2 

1 

1 (Did not finish) 



1 

1 (Did not finish) 



NUMBER OF ERRORS 
0 
1 
2 
3 
5 

10 

12 



In a quiz administered at the end of the period, nine children made 

10036, two made 8556, and two made 5096. 

With the programing method now firmly established, arrangements were 
made to work 25 minutes a week with each of twenty pupils for the remainder 
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of the year. The programer would write from forty to fifty frames before 
meeting the first child, and revisions were made as the child worked through 
the frames. The next child worked with the revised program, euid further 
changes were made if needed. In this manner, each individual worked through 
the program as revised in the preceding trial. A record was kept showing 
the number of errors, the specific errors, the length of time required to 
finish each sequence, unit quiz results, guid any helpful or interesting 
comments made by the children. 

At the end of each period a brief quiz was given to see whether the 
child had grasned the intended word meanings and concepts. If the majority 
of children did not pass the quiz, the sequence of frames was rewritten. 

When seventeen of the twenty children had finished working with the 
first 536 frames, a more extensive test was given. Table 2 shows the results. 

Table 2. 

RESULTS OF A TEST ON THE FIRST 336 FRAMES 
NUMBER OF PUPILS TEST SCORE 

11 10056 

3 9196 

2 7396 

1 6496 

After the sixth sessior^, an attempt was made to get opinions from each 
child concerning the program. All indicated in one way or another that they 
thought it was a good way to learn; several said it was fun. One girl re» 
marked, ’'You don’t learn any conversational Spanish, but you sure learn to 
read and write.” 

Working with twenty children proved to be a slow process. To complete 
the program in time for use in the 1961-62 school year, the number was re- 
duced from twenty to six. Five children were chosen primarily because they 



had higher average error rates than the other — one girl, in particulair, 
nearly always made an error if it were possible. These five children had 
above average I.Q.'s. The sixth child had a relatively low average error 
rate but a more nearly average I.Q. (KA-103). The basic method of program 
building remained unchanged. 

The first 336 frames were duplicated and put in panel book form for 
use with classroom groups. Five classes, representing a wide range of 
ability and background among pupils, were chosen. Two were from schools 
in low socio-economic neighborhoods; two were from middle socio-economic 
areas; smd one large class of fifty-seven pupils was from an upper area. 

A two part test was composed. The first part utilized pictures as keys 
to the answers; the child had no opportunity to copy the test item word 
from the context. This was designed to test accuracy in spelling and in 
the use of diacritical marks. The second part was written entirely in 
Spanish and required complete Spanish sentences to be written for answers. 
Getting a correct answer depended upon an understanding of the context and 
upon skill in organizing the words into sentences. 

The test was administered two weeks prior to the first day of work 
with the programed text. The classes worked on the program three times a 
week for thirty-minute periods, and eight periods were allowed for com- 
pletion of the text. The test was readministered during the ninth class 
period, five weeks after the original testing. 

II. Preliminary Besults 

Analyses of test results and individual pupil statistics compiled in 
developing the program follow. These results are preliminary, of course, 
in that they deal only with pupils participating in the program develop- 
ment phase. The more important and meaningful analysis will involve much 
larger numbers of pupils using automated materials and will compare their 
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learning with that of pupils instructed by the traditional teacher- 
directed methods. This material will be the subject of a later report. 

In the meantime, the preliminary results indicate that pupils 
j definitely learned from the automated program and show some interesting 

relationships between time rate, error rate, and amount learned. Group 
statistics, by school, are given in Table 3 . 



Table 3 . 

GROUP STATISTICS RELATED TO 
USE OF THE FIRST 336 FRAMES 




SIGNIFICANCE OF 
DIFFERENCES BETWEEN MEANS 
ON TESTS COVERING FIRST 336 FRAMES 



School 


Difference 


^D 

M 


CriticsQ. 

Ratio 


Probability 


B 


11.40 


1.69 


6.74 


< .001 


Total 


24.51 


1.27 


19.30 


< .001 



With both probabilities less than .001, there can be no doubt that all 
of the pupils learned from the program. The Pearson product-moment correla- 
tion coefficient between pre- and post-tests was .717, incidentally, which 
indicates a rather even rate of learning among most pupils. 

Two groups, however, showed large variations, and both were from 
neighborhoods classified low in socio-economic status. The group from school 
A had by far the largest gain, and that from school B had the smallest gain. 
In an attempt to determine causal factors, rank correlations (rho's) based 
on group standings were computed between the variables. Table 5 gives these 
rho's. In this computation, the group with the smallest error rate was 

ranked first; for other variables, the group with the highest mean was given 
the highest rank. 



Table 



RANK CORRELATIONS 
BETWEEN PAIRS OF VARIABLES 



VARIABLES 


RHO 


gain X IQ 


.50 


gain X error rate 


*80 


gain X time rate 


*40 


IQ X error rate 


.50 


IQ X time rate 


-.30 


error rate x time rate 


*10 



The IQ relationships are about as esqpected. Hi^er IQ pupils showed 
greater gain, made fewer errors, and took less time than others* The very 
hi^ relationship between gai" and error rate was reassuring since the mini- 
■uB error philosophy of programing had been adopted* Sonetdiat surprising, 
however, was the lack of relationship bet w e a error rate and time rate, 
especially since time rate also correlates with gain* M a l dp g fewer errors 
and taking more time both increase learning, but t. jy seem to mork independ* 
ently. 

These relationships account only in paurt for the great difference in 
ge'i" between groups A and B, and they leave some perplexing <{ue8tlons un- 
answered. Why, for exanqple, should group B*s error rate be more than twice 
that of group A? Why should group A take more time to complete tha program 
than group B? With the negative relationship between IQ and time and the 
hi^er average IQ of group A, the A*s would be esqpected to take less time* 

Evidently group A wais more interested in the program and had greater de- 
sire to learn from it* And, since the program %#riter explained the text and 
instructed «ll groups in the use of it, group A*s greater motivation would 
appear to result from comnon experiences before and/or during their use of the 
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book. This suggests that the classroom teacher had a great effect on the 
amount pupils learned even when using automated instruction materials. 

The second 336 frames had been tested on individuals and printed in panel 
book form by the time the post-test was taken, and the groups from Schools A, 

B, and D continued with the program. Other activities prevented the continua- 
tion of schools C and £. 

Again pre- and post-tests were given, and results, shown in Table 6 , were 
consistent with those of the first set of frames. The Pearson product-moment 
correlation coefficient between pre- and post-tests was .717 ~ the same as 
that for the first tests. 



Table 6 . 

GBODP STATISTICS RELATED TO 
USE OF THE SECOND 336 FRAMES 



School 


N 


Pre-Test 

Mean 


Post-Test 

Mean 


Gain 


Mean 

Error 

Rate 


A 


29 


21.90 


77.76 


55.86 


.020 


B 


28 


6.48 


21.30 


14.82 


.064 


D 


26 


13.17 


31.33 


18.16 


.057 


Total 


83 


13.49 i 
1 


43.84 

1 


30.35 


.046 



Again, a significant amount was learned by all pupils, as the con5>arison 
of means in Table 7 shows. 
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Table 7. 

SIGNIFICANCE OF 
DIFFERENCES BETWEQi MEANS 
ON TESTS COVERING SECOND 336 FRAMES 



School 


t 

Difference 


% 


Critical 

Ratio 


Probability 


B 


14.82 




4.27 


< .001 


Total 

• 


30.35 


3.30 


9.21 


< .001 



As stated before, these results are preliminary. They show that pupils 
definitely learn from the automated instruction program, auid this is important. 
But the real value of the program cannot be assessed until it is compared to 
more conventional teacher«directed instruction. 

The results also indicate that factors other than ability and outside of 
the program itself affect learning. The instruction is automatic in the sense 
that the classroom teacher is not directly involved, but the amount learned 
from the program is not automatic. Determining the causative factors could be 
extremely important, and further research is obviously needed. 

Automated instruction materials will be used in the Denver-Stanford pro- 
ject the following two school years with thousands of sixth grade pupils. 
Initially, efforts will be made to determine the value of automated instruction 
in terms of learning for the type of subject matter and level of pupil in- 
volved, and secondly to isolate some of the factors related to the amount learned. 

This report describes only the development of the first 672 frames — about 
one- third of the total anticipated program. The developmental process as it 
finally emerged seems sound and is being employed in building the remainder of 
the program. It is hoped that the Denver experiences reported here will be 
useful to other programers facing similar problems. 

I ^ 

\ ERIC 
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SUMMARY 



The Problem 

A larce number of studies has established conclusively that instruc 
tional television is an effective teaching device. In the great ^^"ty 
of comparisons, students have learned at least as much through 
as thw have through the more traditional, face-to-face classroom situa- 
tion. Almost all ^f these studies, however, toye employed 
unique teaching device and have not considered the context in it wm 

used. This type of research was necessary to establish the 
television in education, but it does little to define TV s ultima e 

potential • 

Experts in the field have generally agreed that the tot^ learning 
process, in which television plays a role, must now be 
Denver-Stanford project was begun in I960 with this aim, with the study 
of TV presentation methods and classroom and home activities surroun^ng 
television. Using elementary school Spanish in a field research 
the project is attempting to increase the effectiveness of instructional 
television through systematic variation of its context. 

Results 
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The first full school year of research in the project was 1960-61. 
During that year, the research was limited to the 

some 6,000 pupils took part. Six research groups were defied tJ'e 
first semester. All pupils viewed a 15-minute television lesson 
school on Mondays, Wednesdays, and Fridays. The i^oups 
ing to activities in addition to these lessons. The groups and 
activities were: (1) no additional activity, (2) a second viemng of the 
lesson in the home at night, (3) 15 minutes of dialogue practice in the 
classroom after the lesson, W 15 minutes of structure practice in the 
classroom, (5) 15 minutes of eclectic practice in the classroom, and 
(efa second viering of tue lesson at night “i^h parents and ot^r parent 
Lip at home. Mid-term and final tests were administered during the 
semester. Group two performed significantly better than group one 
4.U — tests, jr-oup six performed significantly better than 
earo^ tL’cLssroom pLctice groups performed si^ficantly ^e«er 
group six. Among those with classroom practice, the eclectic Sroup pe 
formL bettfir than the structure group which, in 

than the dialogue group; the only statistically significant differs , 
however, was that between the eclectic and dialogue groups. 
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These results were used to restructure the experimental design for 
the second semester. Group one was eliminated, since it showed little 
promise, aind the other five procedures were continued. In addition, 
six groups combining classroom and home activities were established. 

For three of them, a second viewing at home was combined respectively 
with dialogue, structure, and eclectic classroom practices; and for 
the other three, a second viewing with parent help was combined re- 
spectively with dialogue, structure, and eclectic classroom practices. 

In the test given at the end of tne semester, relative performance 
among the five originail practice groups was the same as it had been 
on firrt semester tests. The combination of evening viewing with class- 
room practice seemed to make little difference; i.e., these groups per- 
formed similarly to those with classroom practice sG-one. The combination 
of evening viewing and parent help with classroom practice made a signi- 
ficant difference, however, and groups in this category performed better 
than any others. Further study of evening activities showed that pupils 
who merely viewed with their parents learned more, irrespective of addi- 
tional activities, than those who viewed alone. The value of other 
parent-pupil activities appeared to increase as the year progressed. 

Covariance ane0.ysis was the main statistical technique employed 
to arrive at the above results. The dependent variable in each case 
was performance on listening comprehension tests developed by project 
personnel. A test of oral ability was sdso used at the conclusion of 
the second semester. 
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RESULTS OF THE FIRST YEAR'S RESEARCH 
IN THE DENVER-STANFORD PROJECT 



by 

John L. Hayman, Jr. 
James T. Johnson, Jr. 



The Denver Public Schools and Stanford University's 
Institute for Communication Research are currently engaged 
in a joint research project on the context of instructional 
television. The purpose of the project is to learn how 
instructional television can best fit into the total teach- 
ing situation. A substantial amount of research has estab- 
lished that television is a very effective teaching medium. 
Ways of combining it with other educational activities must 
now be considered, and the Denver-Stanford project is a 
beginning effort in this direction. Kenneth E. Oberholtzer 
is principal investigator for the Denver Public Schools 
and Wilbur Schramm is principal investigator for Stanford 
University. This is one of a number of project progress 
reports . 



I. BACKGROUND OF THE PROJECT 



Some 400 scientifically designed and statistically treated studies 
on educational television (ETV) have now been completed, and they have 
dealt with a wide variety of subjects at all levels of instruction — 
college, high school, aind grade school. In the great majority of these 
studies, (84 per cent), students instructed by television have learned 
as much as or more than students with conventional classroom instruction. 
As Schramm states in his extensive review of ETV research, "There can no 
longer be any doubt that students learn efficiently from instructional 
television" (Schramm, 1961, p. l). 



These results are of unquestionable importance. However, Runyon and 
Kanner's 1956 observation, that "most (ETV) researchers have been content 
to ask the general question, 'How does television instruction compare in 
effectiveness to regular instruction?’" is still true (Runyon and Kanner, 
1956 , p. 84). The answer to this question would be sufficient perhaps, if 
ETV were always to handle the complete teaching load for a subject, i.e., 
if educators were faced with choosing either televised instruction or 
classroom instruction. 

This is not the choice faced, however. It is possible to use ETV in 
a variety of combinations with classroom and home activities, and tele- 
vision could well be most effective in such combinations. Indeed, the 
few early studies considering such usage suggest that this is the case, 
that using television in conjunction with teacher-directed classroom acti- 
vities increases both learning and motivation of pupils and makes tele- 
vision more acceptable to teachers. But we still know little about what 
these activities should be. 

This situation leads Schramm to conclude; 

• . . the most important research on instructional tele- 
vision, now, ... is research on the total process of which 
television is a part. When Carpenter talks about television 
research as system research (Carpenter, I960), he is, in effect, 
asking how television fits into the learning experience. How 
can it be used best, and for what? How can it best be combined 
with other experiences, to make learning a given subject most 
efficient (Schramm, I 96 I, p* 28)? 

The Denver-Stanford project, which has the official title, "Four Years 
of Research on the Context of Instructional Television," is designed to 
consider some of the problems which now seem most important in ETV. In 
it the whole teaching situation of which television is a part is studied, 
with as many elements varied as can be handled. The attempt is made to 
see where television fits into the pattern and what combinations of 
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activities and facilities can be put together with it to increase learn- 
ing efficiency. 

The project was conceived in 1959 when the Denver Public Schools and 
the Stanford Institute for Communication Research were brought together by 
the National Educational Television and Radio Center (NETRC), whose prin- 
cipal officials were concerned vdth the need for research on the context 
of ETV. A joint project was suggested so that the facilities and interests 
of both a large city school system and a research institute could be 
brought to bear on the problem. 

Foreign language in the elementary school was selected as the subject 
matter to be tau^t, with Spanish the specific leuiguage. There were 
several reasons for this choice. For one thing, a shortage of elementary 
school classroom teachers qualified to teach foreign language makes the 
use of television a necessity in this area. For another, foreign language 
is an addition to the elementary school curriculum which seems to be 
called for, and which has already begun in many school systems* Further- 
more, it is an innovation which hsis not been frozen by years of use and 
thus lends itself well to experimentation. 

A proposal was submitted to the United States Office of Education in 
June, 1959, for a grant under Title VII of the National Defense Education 
Act, and this was approved a few months later* A joint research team from 
the two organizations was then created to be directly responsible for the 
tasks required. The Institute for Communication Research assigned re- 
search personnel to this team and the Denver Public Schools assigned 
specialists in education, language, and television teaching and pro- 
duction. In addition, Denver made available the facilities of KRMA-TV, 
an educational station which it operates. 

Actual work c;i the project began in January, I960, with these general 




hypotheses to be tested: 

1. Instructional television of a certain kind, reinforced by certain 
classroom activities, makes for more learning, ceteris paribus, 
than without this reinforcement. 

2. Instructional television of a certain kind, reinforced by cer- 
tain home activities, makes for more learning, ceteris paribus, 
than without this reinforcement. 

3» Instructional television of a certain kind, reinforced by cer- 
tain home and classroom activities, makes for more learning, 
ceteris peiribus, than without these reinforcements or with 
either one alone. 

4. Certadn kinds of instructional television, combined with certain 
kinds of home and classroom reinforcements, make for more leeu:ii- 
ing, ceteris paribus, than other kinds and combinations. 

These imply systematic variation of what pupils see on the television 
screen; of cleissroom activities, including pupil use of tape recorders, 
record players, automated instruction materials, cOid the like, in addi- 
tion to teacher-conducted instruction; and of home activities, including 
those with and without parent participation. 

The first months of the project were used mainly for orientation of 
project personnel and for planning and preparing for the 196O-6I school 
year. A preliminary experiment was conducted in May, I960, however. 

S(xne 550 fifth grade pupils in their first year of SpcUiish instruction 
were used to compare three methods of television presentation. The methods 
were (1) lecture, (2) modified lecture with elicited student participation 
in the classroom, and (3) modified lecture with instructor-student inter- 
action in the studio and student participation in the classroom. Covariance 
analysis of overall between group differences gave a frequency ratio of 
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2 . 05 ^ which, with of 2 and n 2 of 506, is significant at approximately 
the .075 level. Individual group comparisons showed that method three 
produced the highest mean and method two the lowest, and the difference 
between groups three and two was significant at the .059 level. Neither 
of the other differences wais significant, though that between groups one 
and two ( critical ratio of ld8l) was relatively lairger thaui that between 
groups three and one (critical ratio of 0.433) • A replication of this 
experiment is planned (for a complete report, see Hayman, 1961). 

The results of the preliminary experiment led to the choice of presen- 
tation method three for the television lessons. Thus aill pupils in the 
project have the same television experience: they auce led by the tele- 

vision teacher to practice correct responses during the program and they 
see pupils from their own grade interact with the teacher. To aissure that 
the television lessons ao*e of high quality auad incorporate the desired 
chau:‘acteristics, and to make certadn that the television experience of 
one group can be repeated later for another group, all lessons are re- 
corded on video-tape prior to the telecasting. 

II. RESEARCH DESIGN 
FOR THE 1960-61 SCHOOL YEAR 

a. Research Groups for the First Semester 
The first year's research was designed to be conducted at the fifth 
grade level in two stages. In the first semester, a number of single pro- 
cedures would be compared. The most promising of these would then be 
tried in various combinations during the second semester. 

Foreign language was made a required subject for all fifth graders 
in the Denver Public Schools at the beginning of the I 96 O- 6 I school year, 
and some 6,500 pupils chose Spanish (French was the other possibility) and 
v/ere automatically in the project. Every pupil viewed the 15-minute tele- 
vised lesson on Monday, VJednesday, and Fridciy of each week, so the tele- 




vision eaqperience was the same for each* The main effects to be compared, 
then, were activities in addition to classroom television. In other 
words, the context of the television was changed for different groups. 

For the first semester, the research groups and activities in addi- 
tion to viewing the in-school telecast were: 

1. No additional activity . Pupils in this group saw the telecasts 
in school and did nothing else. Their performance served as a 
base against which to compare the effectiveness of other 
activities. 

2. A second viewing of the television lesson. Each television 
lesson was repeated at night on KRMA— TV, and pupils in this 
group viewed it in their homes. This vas a repetition for them 
since they had seen it earlier in school. 

3* Dial ogue practice in the classroom * Pupils in this group took 
part in dialogue practice conducted by their classroom teacher. 
Each practice session lasted 15 minutes and occurred imme- 
diately after the television lesson. 

4» Structure practice in the classroom * This group was similar to 
group 3 except that structure practice was used in the classroom. 

5* Eclectic practice in the classroom * This group was similar to 
groups 3 snd 4 except that eclectic practice was used in the 
classroom. 

6. A second viewing of the lesson and parent help . Pupils in this 
group viewed the television lesson at night with their parents 
and had other types of parent help at home. This group was the 
same as group 2 except for parent help* 

The activity followed by group two was designed to test the value 
of repetition, which has often proved a powerful variable in education. 



Group six was set up to determine if direct parent aid would be of value to 
pupils in this situation. Pao*ents were provided with a phonograph record 
especially designed to complement the television lessons and with a study 
guide which suggested a number of home activities. Parent participation in 
the project is described fully in a previous progress report (Hayman and 
Johnson, 1961) . 

The teacher-conducted classroom activities of groups three, four, and 
five are defined as follows: 

A dialogue drill consists of a short, meaningful conversation between 
two people. The pupil learns the part of one person in the conversation 
with the teacher tadcing the other part. Then the roles are reversed, with 
the pupil taking the other part. Finally, two pupils use the drill to con- 
verse. Dialogue practice is saiid to be valuable in language leaurning 
because : 

It involves a naturad and exclusive use of the audio-lingual skills. 

. • . All that is leaurned is meainingful, and what is learned in one 
pau^t of a diadogue often makes meaining clear in another. From the 
staurt the student learns to address people directly and to use the 
first person singular — items of basic importaince in communication. 

If the materials aure appropriate, the learner finds a personal in- 
terest in what he is saying and a possible use fair beyond the class- 
room for the expressions which he masters (Brooks, I960, p. l4l). 

Structure drill involves repetition of a lamguage pattern with small 

amd consistent changes at each repetition. The pattern usuadly consists of 

a single sentence, and any word or phrase in the sentence may be changed. 

The following is an example in English with the verb vau:*ied: I see an 

apple; I buy am apple; I eat an apple; I like am apple; etc. Structure 

practice, as opposed to dialogue, is not meaningful communication per se. 

It is to communication what playing scades amd arpeggios is to 
music: exercise in structural dexterity undertaken solely for the 
sake of practice, in order that performance may become habitual and 
automatic — as it must be when the mind concentrates on the message 
rather tham on the phenomena that convey it. Structure practice 
capitalizes on the mind's capacity to perceive identity of structure 
where there is a difference in content, amd its quickness to learn 
by analogy (Brooks, I960, p. 142). 
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Though dialogue drill and structure drill are both valuable in Isinguage 
learning, neither would ordinaurily be used as a single teaching method; 
rather, some combination would be used. They were, in fact, used in combi- 
nation with television instruction in the project. A cogent question was 
whether the normal type of classroom activity rather thaui am isolated 
method would be more effective with ETV. To answer this, the eclectic 
practice warn used. This practice combined dialogue amd structure drill 
with other items such as naurratives, songs, and games. 

b. Assignment of Pupils and Teachers to Groups 

Research groups three, four, amd five required reasonably well quali- 
fied Spamish teachers since they involved active classroom instruction. 
Teachers in groups one, two, amd six, on the other hand, had a passive 
claissroom role and did not have to be as well qualified in Spamish. There- 
fore, all teachers in the project were classified according to their quali- 
fication for Spamish instruction. Prior tradning amd teaching e 3 q>erience 
were the classification criteria. 

Qualified teachers were assigned randomly to groups three, four, and 
five, amd less qualified teachers were assigned randomly to groups one. 
two, amd six. This assignment procedure assured similairity of teaching 
ability among the three groups with classroom instruction amd aunong those 
who had only television in the classroom. 

No attempt was made to control pupil assignment from the research pro- 
ject office. Over 6,000 pupils in some 90 elementary schools were involved, 
and scheduling problems in the individual schools made centrail control im- 
possible. This meamt that similarity of learning potential, among groups 
was not assured. With one exception, however, no biasing factor was in- 
volved since pupils were assigned to classes before teachers were assigned 
to research groups. The exception was group six. Classes were not placed 
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in group six unless a majority of parents in the class volunteered to 
participate, and this selection factor could create differences. (See 
Hayman and Johnson, 1961, pp. 9-12, for its actual effect.) 

c • Teacher Trsdning 

For a valid comparison of the dialogue, structure, and eclectic prac- 
tices, it was necessary for teachers in groups three, four, and five to 
follow the exact procedure to which they had been assigned. This, in turn, 
depended on their understanding of the procedure and of the purpose of the 
project. 

A program of teacher training was established under the direction of 
the Denver Public Schools' Supervisor of Foreign Languages. One phase of 
this program consisted of summer workshops for which college credit was 
granted. Fifty teachers, over one fourth of those in the project, attended 
the workshop in I960, just prior to the first year of research described 
herein . 

The second phase of the teacher training program consisted of instruc- 
tional sessions held during the school year. The first of these lasted a 
half day and occurred before any classes had met. Teachers were told of 
the background of the project and of the questions for which answers were 
sought. Their essential role in securing valid results was emphasized. 

Then instruction in individual procedures was given. Finally, each group 
received guides which further explained the procedure to be followed and 
provided classroom drills. 

Five other training sessions were held during the school year. Two 
of these were televised, two were conducted in individual schools, and one 
was a general meeting at the beginning of the second semester . At each 
session, teachers concerned with a specific procedure were given instruc- 
tion in that procedure. The general meeting included a discussion of 
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progress to date, problems encountered, and future plans. 

In addition to the formal sessions, staff personnel met with indivi- 
dual teachers during the year to discuss procedures and help with indi- 
vidual problems. These meetings were scheduled on a random basis within 
each research group to aissure that teachers in each group had the same 
amount of individueil help. 

As stated above, the primary purpose of the teacher training was to 
make certain that sissigned procedures were followed properly. A second 
purpose was to increase the proficiency of all teachers in the project, 
including those not considered qualified for an active role at the be- 
ginning of the year. All teachers were asked to participate during the 
television lessons, i.e., to follow the TV instructor closely and to respond 
when response was requested. With television instruction, the in-service 
training sessions, and the summer workshops, it was hoped that every teacher 
could handle at least the beginning level of Spanish during the following 
school year (1961-62) . 

Teacher training will be the subject of a project progress report to 
be published shortly and will be more fully discussed there. 

d. Information Collected 

The exclusive use of audio-lingual teaching methodology during the 
first year of research meant that only listening and speaking skills would 
be evaluated. This simplified measurement in the sense that it limited the 
number of instruments needed, but it complicated it in that pupils could 
neither read nor write in Spanish and translation was strictly avoided. 

The lack of suitable measuring instruments necessitated development of such 
instruments by the project staff. Three listening comprehension tests were 
developed and administered via television during the school year (Andrade, 
Hayman, and Johnson, 1961). Pupils responded by marking choices 
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(mostly of pictures) on a standard answer sheet, and scoring was handled 
at the project office. One test was given about two thirds of the way 
through the first semester to allow restructuring of research groups at 
mid-year, and the other two tests were finals for the first and second 
semesters . 

Measurement of speaking ability is considerably more difficult. An 
actual speaking performance of the pupil must be evaluated, and the fact 
that more than 6,000 pupils were involved made scoring by a few staff mem- 
bers impossible. Scoring in this situation is difficult and subjective at 
best, and reliability is certain to be quite low unless well- trained experts 
are used. Considerable effort went into development of an oral test, which 
was tried on a limited basis at the end of the first semester. Although 
this test, after certain revisions, seemed satisfactory in terms of validity 
qnH reliability, staff members felt that it could not be administered and 
scored satisfactorily on a broad basis. The solution for I96O-6I was to 
choose a random sample of 4 o pupils each from research groups two through 
six and test these pupils the last week of the second semester. The ulti- 
mate goal is to develop oral tests which can be administered and reliably 
scored by the average classroom teacher. A later progress report will be 
concerned with measurement of speaking skills. 

These test results constituted the criterion or dependent variables 
for the first year of research. As mentioned previously, however, the pupil 
assignment method did not assure similarity of learning ability among the 
research groups. The obvious statistical technique for this type of situa- 
tion is covariance analysis, which controls for group differences. To use 
covariance, measurements on key variables related to the dependent variable 




must be available. 

A number of scores in addition to those of the criterion tests were 
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therefore collected for each pupil. These included: IQ, age, grade point 

average in academic subjects (GPA), sex, occupation of the head of the 
household (as an indication of socio-economic status) , and Steinford Achieve- 
ment Test scores in paragraph meaning (PM) , word meaning (WM) , spelling 
(SP), language (L) , arithmetic comprehension (AC), and arithmetic funda- 
mentals (AF). Pupils in groups two and six were given calendars on which 
to indicate the number of evening telecasts they watched, and group six 
parents were asked to indicate the number of evening telecasts they watched 
and to show the number of minutes they practiced Spanish with their child 
each week. 

e. Research Groups for the Second Semester 

The first listening comprehension test was evaluated in time to serve 
as a basis for restructuring the research design for the second semester. 
This test showed conclusively that the practice followed by group one (a 
single viewing of the TV lessons) was not as effective as the other proce- 
dures, and this practice was eliminated. Since the other five practices 
all showed promise, they were retained. In addition, six combination groups 
were established. These consisted of combining a second viewing with dia- 
logue, structure, and eclectic classroom practice and of combining parent 
help with dialogue, structure, and eclectic classroom practice. 

As in the first semester, teachers were assigned to groups and their 
pupils automatically went with them. A few teachers who had been in groups 
one and two desired a more active role, and they v^ere assigned randomly to 
the three classroom procedures. Each classroom procedure group was in turn 
randomly divided into two parts , and one part was given the second viewing 
in the evening. For the most part, then, teachers in the classroom practice 
groups and the classroom practice plus evening viewing groups had had an 
active teaching role the first semester. 
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Teachers for the parent help-classroom practice combinations had to be 
drawn from those who had been in the parent help groups the first semester* 
This was necessary because teachers could not be moved to a different class 
at mid-year and because no new parent participants were to be added without 
benefit of the first semester. Therefore, teachers who were with parent- 
help pupils the first semester were randomly divided into four groups. One 
of these continued as a parent help group with no classroom practice and 
the other three were assigned to classroom practice -- one each to dia 3 .ogue, 
structure, and eclectic. This assignment procedure meant that teachers in 
the classroom practice-parent help groups were on the average not as well 
qualified to teach Spanish as those in the other classroom practice groups. 

Ill . FINDINGS 
a. The First Semester 

The first listening comprehension test was administered in December, 
about two thirds of the way through the fall semester. Means for the six 
research groups (identified on page 6 ) on the 50 -item test and on the six 
variables chosen for control purposes are given in table 1 . 



Table 1 
GROUP MEANS 

ON THE DEPENDENT AND CONTROL VARIABLES 



Variable 


Group 


1 


2 


3 


4 


5 


i 

6 


Total 


Test 

IQ 

PM* 

WM* 

SP* 

L* 

GPA* 


26.813 

99.844 

51.735 

53.003 

50.636 

52.595 

2.591 


29.391 

100.018 

52.650 

52.439 

50.643 

50.952 

2 . 6 l 4 


33.398 

99.380 

50.793 

51 .'t 25 

50.864 

58.493 

2.578 


33.544 

100.960 

51.827 

53.095 

50.129 

54.956 

2.588 


33.816 

99-482 

52.629 
52.779 
50.129 
50.010 
2.576 
_ 1 


32.694 

100.926 

54.901 

54.252 

50.575 

57.531 

2.662 




31.609 

100.100 

52.422 

52.832 

50.799 

54.256 

2.602 



♦Stanford Achievement Scores (PM, VJM, SP, L) are in terms of grade place- 
ment times ten. Grade point average (GPA) was computed as follows: 
D=l, C= 2 , and A = 4 . 



The control variables were selected on the basis of experience gained 
in the May preliminary experiment and of a series of multiple correlations 
between the dependent variable and different combinations of potential con- 
trol variables. The variables not used were rejected even though they had 
a low positive correlation with test score. They could add nothing to the 
analysis because all the variance they had in common with test score was 
accounted for by the control variables listed in table 1. In fact, further 
study showed that V/M, SP, and L could also be eliminated without changing 
the results of the analysis; therefore, IQ, PM, and GPA were the only con- 
trol variables used in other statistical work for the remainder of the year. 

Pearson product moment correlations between pairs of variables are 
shown in table 2. 



Table 2 

CORRELATIONS BETWEEN 
PAIRS OF VARIABLES 



Variable 


Variable 


IQ 


PM 


WM 


SP 


L 


GPA 


Test 


.392 


.395 


.387 


.372 


.364 


.371 


IQ 




.701 


.729 


.704 


.615 


.683 


PM 






.826 


.710 


.629 


.683 


WM 








.755 


.645 


.672 


SP 










.635 


.699 


L 












.601 



A one-dimensional covariaince analysis was run to test the overall 
differences between groups. As table 3 indicates, this analysis gave an 
F-ratio of 6?. 359 which, with n^ of 5 and n£ of 1752, had a probability 
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less than .001. For this analysis, a random sample of 29^ pupils was drawn 
from each of the six research groups, giving a total N of 1?64. 



Table 3 

COVARIANCE ANALYSIS OF 
THE FIRST SEMESTER MID-TERM 



Source of 
Variation 


Residual 


DF 

-i 


Sums of 
Squares 

! 


Mean 

Square 


Total 

Groups 


1 

1757 


1 

1 

73,319.270 




Within 

Groups 


1752 


61 , 497.260 


35.101 


Difference 

(Between 

Groups) 


5 

'V ' 


11 , 822.010 


2,364.402 



_ 2,364.402 . ^ 

^ " 35.101 " 

n, = 5 n2 = 1752 

P < .001 



The covariamce analysis leaves no doubt that real differences among 
groups were found. To compare the individual groups, mean scores were ad- 
justed by the covariance technique, and critical ratios of differences be- 
tween group mecuis were computed. The standard deviations used were de- 
rived from the group variances given in table 4. Table 4 also shows the 
adjusted group means. Table 3 gives the obtained critical ratios and 
their probabilities. 
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Table 4 



ADJUSTED GROUP MEANS AND VARIANCES 
FOR THE FIRST SEMESTER MID-TERM 





, Research Group 


1 


1 

2 


3 


4 


5 


6 


Total 


Group 

Mean 


26.909 


29.448 


33 . '♦99 


1 

33.519 


1 

, 33 . 91'^ 


32.341 


31.609 


Group 

[Variance 


j 54.5^9 


60.009 


55.935 


'♦5-937 

1 


48.726 


'♦5-937 


51.880 



Table 5 

SIGNIFICANCE OF DIFFERENCE BET’7EEN MEANS 
FOR THE FIRST SEMESTER MID-TERM 



Groups 


Difference 


®DM 


OR 


P 


2-1 


2.539 


.624 


'♦.068 


’<.001 


6-2 


2.893 


.600 


4,821 


<.001 


3-6 


1.158 


00 

00 

• 


1.969 


= .049 


4-3 


0.020 


.588 


0.034 


>.400 


5-3 


0.415 


.596 


0.696 


>.200 


5-4 


0.395 


.567 


0.696 


>.200 



Table 5 shows that a second viewing at night (2) was significantly 
superior to merely watching the television lessons during school (l), that 
a second viewing at night plus parent help (6) was significantly superior 
to the first two procedures, and that having classroom instruction (3» 4, 
and 3) was significantly superior to anything else. No significant differ- 
ences occurred among the three classroom instruction groups, although the 
eclectic group had the highest mean cuid the structure practice group was 
second. 

The second listening comprehension test was given the last week of the 
first semester. It also contained 50 items, 23 of which were repeated from 
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the first test. The same subjects were used in the analysis so far as 
possible. Absences during the test administration necessitated replac- 
ing 309 , however. Replacements were drawn rauidomly from the different 
groups. Control vaa-iable means and correlations between variables re- 
mai n pri sibout the same as indicated in tables 1 and 2. The correlation 

between the first two tests was .735. 

Table 6 gives unadjusted group means for the first semester final^^ 

Table 6 

UNADJUSTED GROUP MEANS 
FOR THE FIRST SEMESTER FINAL 



1 








Group 








1 


2 


-3 


4 


5 


6 


Total 


Mean 


30.491 


33.087 


37.497 


1 38.484 


38.797 


35.535 


35.644 



Results of che one-dimensional covcuriance analysis of the first semes- 
ter final are shown in table 7- In this analysis, the F-ratio was 6l.Ol4, 
qnri the probability again wais far less than .001, indicating real differ- 
ences among the groups. 

Agaj.n group means were adjusted and differences between them tested 
for significance. Variances and adjusted means are given in table 8, and 
table 9 shows the significance tests. 
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Table 7 

COVARIANCE ANALYSIS OF 
THE FIRST SEI 4 ESTER FINAL 



Source of 
Variation 

i - 


Residual 


DF 


Sums of 
Squares 


Mean 

Square 


Total 

Groups 


1725 


114 , 224.232 




Within 

Groups 

1 1 


1720 


97 , 016.748 


56.405 


Difference 

(Between 

Groups) 


5 


17 , 207.484 


3,441.496 



.014 



" = 5O05 = ' 

11]^ = 5 112 = 1720 

P < .001 



Table 8 

ADJUSTED GROUP MEANS AND VARIANCES 
FOR THE FIRST SIMESTiilR FINAL 





Research Group 




1 

1 


2 ! 

1 


3 




1 5 


6 ! 
« 


Total 


Group 

Mean 


30.455 


33.020 


37.895 


38.646 


1 

39.007 


1 

1 34.868 


35.644 


Group 

Variance 


85.340 


80.222 

1 


70.259 


66.799 


58.821 


62.836 


79.819 
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Table 9 

SIGNIFICANCE OF DIFFERENCE BETVEEN MEANS 
FOR THE FIRST SEMESTER FINAL 



Groups 


Difference 


% 


CR 


P 


2-1 


2.565 


.756 


3.392 


<.001 


6-2 


1.848 


.704 


2.625 


=.008 


3-6 


3.027 


.680 


4.451 


<.001 


^ - 3 


0.751 


.691 


1.086 


>.100 


5-3 


1.112 


.669 


1.662 


=.048* 

=.097* 


5-4 


0.361 


.659 


0.5'f? 


>.200 


♦ 


= .048 on a one-tailed test 



P = .097 on a two-tailed test 

A comparison of means in tables 4 and 8 and of differences in tables 
5 and 9 shows a high degree of consistence between the two tests adminis- 
tered during the first semester. The rank order of groups was exactly the 
same« and differences between the groups were quite similar. The pro- 
babilities were similar, in fact, with two exceptions. First, group five 
(eclectic classroom practice) gained in relation to groups three and four 
so that it was significantly superior to three on a one-tailed test. 
Second, group six slipped somewhat relative to the others; it was closer 
to group two, although still superior at the .008 level. 

b. The Second Semester 

The second semester listening comprehension test was administered via 
TV in May. This 50 item test covered content of the second semester only 
and did not include any items used in previous tests. Of the 2,002 pupils 
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included in the analysis, IhOO were used in analysis of the first semester 
final and 602 were new additions. The research groups and the number of 
pupils in the analysis from each group are shovm in table 10. 

Table 10 

GROUPS AND NUMBERS OiT SUBJECTS IN THE 
ANALYSIS OF THE SECOND SEMESTER FINAL 



Group 

Number 


(First Semester 
Identification) 


Practice Followed: 

TV Viewing in the Classroom Plus 


Number of 
Subjects 


1 


(2) 


A Second TV Viewing at Night 


91 


2 


(3) 


Dialogue Practice in the Classroom 


l66 


3 


(4) 


Structure Practice in the Classroom 


210 


4 


(5) 


Eclectic Practice in the Classroom 


l6l 


5 


(6) 


A Second TV Viewing at Night and Parent 
Help 


ll6 


6 


(2-3) 


A Second TV Viewing at Night plus Dialogue 
Practice in the Classroom 


272 


7 


(2-4) 


A Second TV Viewing at Night plus Structure 
Practice in the Classroom 


274 


8 


(2-5) 


A Second TV Viewing at Night plus Eclectic 
Practice in the Classroom 


291 


9 


(6-3) 


A Second TV Viewing at Night and Parent 
Help plus Dialogue Practice in the Classroom 


138 


10 


(6-4) 


A Second TV Viewing at Night euid Parent 
Help plus Structure Practice in the 
Classroom 


149 


11 


(6-5) 


A Second TV Viewing at Night and Parent 
Help plus Eclectic Practice in the Classroom 


134 






TOTAL 


2002 



The May test was examined in two ways. In one analysis, the first 
semester final was used as a control variable , so that only the amount 
learned during the second semester was reflected. This procedure was 
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appropriate for examining those practices which were instituted at the 
start of the second semester. In the second analysis the first semester 
test was not used as a control variable, and the amount learned during 
the vdiole year was reflected. This procedure was used in examining prac- 
tices followed throughout the year. Groups one through five followed the 
same practice both semesters, and groups six through eleven had a new 
practice introduced in the second semester . 

A one-dimensional covariance analysis, with IQ, grade point average, 
and Stanford achievement score in word meaning used as control variables, 
was run for each situation. Results of these analyses are given in 
table 11 . 



Table 11 

ONE-DIMENSIONAL COVARIANCE ANALYSES 
WITH AND WITHOUT THE JANUARY TEST USED AS A CONTROL VARIABLE 



With the January Test 


1 


Without the January Test 


Source of 
Variation 


Residual 


Source of 
Variation 


Residual 




Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


Total 


1997 


25,509.556 




Total 


1998 


84 , 469.610 




V/ithin 

Groups 


1987 


25,975.051 


12.066 


Within 

Groups 


1988 


78,502.071 


59.488 


Between 

Groups 


10 


1,554.505 


155.451 


Between 

Groups 


10 


5,967.559 


59S.754 


P < .001 


596.7^ _ 1C 2 . 12 * 
^ ■ 59.“>88 

P < .001 



♦F of 7.64 required for .001 level of significance. 
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With or without the first semester final (January test) as a control 
variable, the overall results were highly significant, and examination of 
group means was in order. Unadjusted group mecuis, means adjusted for the 
first semester final, and group variances are given in table 12. 

Table 12 

UNADJUSTED MEANS, MEANS ADJUSTED FOR 
THE JANUARY TEST, AND GROUP VARIANCES 



Group 


1 

Unadjusted Mean 


Mean Adjusted 
for January Test 


Variance 


1 


27.901 


32.057 


57.520 


2 


34.120 


35.251 


58.327 


3 


35.519 


35.709 


57.556 


4 


36.062 


36.075 


39.143 


5 


34.802 


33.001 


40.839 


6 


35.066 


34.830 


53.774 


7 


35.575 


35.'*72 


50.790 


8 


35.572 


35.503 


51.598 


9 


37.116 


36.464 


34.492 


10 


36.671 


36.218 


35.004 


11 


36.627 


35.671 


39.080 


Total 


35.283 


35.283 


51.529 



Again the outcome is consistent with previous findings. However, there 
was one rather surprising result. The classroom practice plus evening view- 
ing had a lower mean in each case than classroom practice alone; i.e., 
dialogue classroom practice plus evening viewing (6) was lower than dialogue 
classroom practice alone (2); structure practice plus evening viewing (?) 
was lower than structure practice alone (3)» and eclectic practice plus 
evening viewing (8) was lower than eclectic practice alone (4). One would 
expect the second viewing to increase learning. Significance tests in 
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table 13 show that each difference had a probability greater than .35* 
however, so these differences must be considered chance fluctuations 
and the null hypothesis — that evening viewing made no difference when 
combined with classroom practice ~ accepted. 



Table 13 

significance of differences betv/een means 

WHERE ONLY SECOND SEMESTER LEARNING IS REFLECTED 



Groups 

Compared 


Difference 




Critical 

Ratio 


Probability 


2-6 


.421 


.741 


.568 


> .50 


3-7 


.237 


.678 


.350 


> .50 


4-8 


.572 


.648 


.883 


> .35 


9-2 


1.213 


.775 


1.565 


= .12 


10-3 


.509 


.713 


.714 


> .40 


4-11 


.404 


.731 


.553 


> .50 


11-5 


2.670 


.802 


3.329 


< .001 


6-1 


2.773 


.991 


2.798 


< .01 


5-1 


.944 


.817 


1.155 


= . 13 * 


2-5 


2.250 


.838 


2.685 


< .008 


3-2 


00 

^ 1 

• 


.790 


.580 


> .30 

► 


4-2 


.824 


.771 


1.069 


= ,14* 


7-6 




.619 


1.037 


> .20 


VO 

1 

CO 


.673 


.612 


1.100 


> .20 


9-10 


.246 


.696 


.353 


> .50 


9-11 


.793 


.736 


1.077 


> .25 



♦One-tailed test 



o 



r eric 

\ hiaifflyHaiTiTiaij 

^ 



24 



For an overall check on this, all classroom practice groups were com- 
bined and compared to classroom practice plus evening groups combined. The 
meain for classroom practice alone was 35*660 and for classroom practice plus 
evening viewing was 35*251, giving a difference of .409* The critical ratio 
for this difference was 1.023, which has a probability of about .30. 

A second viewing in the evening plus classroom practice was signifi- 
cantly better than a second viewing alone (1). The difference in means was 
3 . 194 , which had a critical ratio of 3*834 and a probability less than .001. 

Classroom practice plus evening viewing and parent help (groups 9, 10, 
and. 11 ) gave results closer to what was expected. In two of the three com- 
parisons, parent help groups did better, thouj’'h for the eclectic groups 
(4 and 11) classroom practice alone was slightly better. Again none of the 
differences (9-2, 10-3, 4-11) was significant. The difference between 
means of combined groups, hov/ever, was significant. In this comparison, 
the classroom practice plus evening viewing groups were combined with 
classroom practice alone, since the evening viewing made no significant 
difference. The mean of classroom practice groups v/as 35*431 and that of 
classroom practice plus parent help groups was 36 .II 8 . The difference of 
.757 had a critical ratio of 2.151, significant at the .03 level. 

Classroom practice plus evening viewing and parent help was far better 
than evening viewing and parent nelp alone (5)* Pupils in the latter cate- 
gory had a mean of 33.001. The difference in means of 3*l87 gave a critical 
ratio of 4.8l4 and a probability less than .001. 

A major concern was the comparison of the three types of classroom 
practice. In both tests administered during the first semester — the 
December mid-term and the January final — the eclectic practice group 
did best, the structure practice group v;as second, and the dialogue prac- 
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tice group was third. On the January test, the difference between 
eclectic and dialogue was significant at less than the .05 level on a 
one-tailed test. 

In the present analysis, which accounts only for second semester learn 
ing, the order of groups was the same for classroom practice alone and for 
classroom practice plus evening viewing as before. None of the differ- 
ences (3~2, 4-2, 7-6, 8-6) was significant, however. When evening viewing 
groups were combined with classroom practice groups, which was logical 
since evening viewing had no significant effect, the difference between 
eclectic practice groups and dialogue practice groups was significant at 
the .076 level on a one-tailed test. The difference between meauis for 
these groups was .692 and the critical ratio was 1.439* 

Among groups with classroom practice and parent help, however, the 
order of groups was reversed, with dialogue practice (9) best, structure 
practice (10) second, and eclectic practice (11) third. No difference was 
significant; however, the probability of the greatest difference (9 - H) 
was greater than .25. The relative standings can therefore be attributed 
to chance. The possibility of an interaction between classroom practice 
and evening activities existed, however, and required further checking 
before any conclusions could be drawn. 

A two-dimensional covariance analysis was run with classroom practice 
as the first effect and evening activity as the second effect. The January 
test result was used as the only control variable in this analysis since 
it was found in the one-dimensional analyses to account for practically 
all the variance attributable to the other control variables. The two- 
dimensional analysis is given in table l4. 
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TaHle 14 

TWO-DIMENSIONAL COVARIANCE ANALYSIS 
COMPARING CLASSROOM PRACTICE AND EVENING ACTIVITIES 



Source of 
Variation 


Residual i 


Frequency 

Ratio 

I 

i 

^ 1 


Probability 


Degrees of 
Freedom 


Sum of 
Squares 


Mean | 

Square 


First 

Effect 


2 


48.791 


24.596 


'! 

! 

i *1.577 


> .10 


Second 

Effect 


2 


338 . 7^7 


169.574 


9.562 


< .001 


Interaction 


4 


157.661 


54.415 


1.943 


> .10 


Within 

Groups 


1785 


51,617.281 


17.715 







N = 1795 



This analysis shows that, with the three types of evening activity 
combined, no significant variation was produced by different types of class- 
room practice (first effect). With types of classroom practice combined, 
however, different evening activities did produce a significant variation 
(second effect). These results agree with comparisons in table 13 - 

More important, the interaction was not significant. Therefore, the 
inconsistency among classroom practices when combined with different even- 
ing activities, which was noted earlier, must be attributed to chance 
fluctuation. 

The practices followed by groups one through five continued unchanged 
throughout the school year. A more valid comparison of these groups, then, 
would reflect the complete year's learning. That is, the second semester 
final should not be controlled for the January test. Group means for the 
whole year, controlled only for IQ, grade point average, and word meaning 
score, are shown in table 15 . Results for the groups who had classroom prac- 
tice the whole year and evening viewing the second semester are included 
since the evening viewing had no significant effect. 
o 
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Table 15 

GROUP MEANS REFLECTING 
LEARNING FOR THE VWOLE YEAR 



f 


Group 






.1 , .1 -3 


4 


5.. .... 


6 1 


7 


8 


Mean j 


1 1 

28.117 1 35.178 i 35.807 


35.8o4 


33. I'll 


35- 028 ! 


36.058 


35.980 



Significamce tests for differences between meauas are given in table l6. 



Table l 6 

SIGNIFICANCE OF DIFFERENCES BET^'LEN MEANS 
WHERE LEARNING FOR THE VJHOLE YFJiR IS REFLECTED 



Groups 

Compaxed 


i 

1 

Difference j 


^ ^D 
^M 


Critical 

Ratio 


Probability 


5-1 


5.024 


.817 


6,149 


< .001 


2-5 


2.037 


• 

00 

00 


2.431 


= .015 


3-2 


.629 


.790 


.796 


> .20 


4-2 


.626 


.771 


• 

00 

ro 


> .20 


7-6 


1.030 


.619 


1.664 


= .04?* 


8-6 


.952 


.612 


1.556 


= .O 6 O' 


f 7-8 


• 

00 


.602 


.130 


> .50 



♦ One-tcdled test 



Results for the year are nimilar to those attained on both the first 
semester tests. The parent help group (5) performed significantly better 
than the group with a second viewing (1), and the lowest classroom prac- 
tice group (2) was significsmtly better than the parent help group. 

Dialogue practice groups (2 and 6) were poorest. The structure prac- 
tice groups O and 7) and the eclectic practice groups (4 and 8) had almost 
identical results. 

In all three tests the differences between structure practice and eclec- 
tic practice was slight^ with the probabilities greater than . 50 , indicat? 4ig 
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chance fluctuation and acceptance of the null hypothesis. 

The differences between dialogue practice groups and structure and 
eclectic practice groups were not significant for classroom practice alone 
(2, 3, 4), but they were significant where classroom practice was combined 
with evening viewing (6, 7, 8). 

In view of the fact that evening viewing made practically no differ- 
ence to groups with classroom practice, combining evening viewing groups 
with classroom practice groups in testing results for the whole year seemed 
logical and desirable. When this was done, the dialogue practice group had 
a mean of 35*086, the structure practice group a mean of 35*949 » and the 
eclectic group a mean of 35*917* The difference between means of the struc- 
ture and dialogue practice groups was .863 which had a critical ratio of 
1.768, significant at the .038 level on a one-tailed test. The difference 
between eclectic and dialogue practice group means was .831, giving a 
critical ratio of 1.728 and a probability of .042 on a one-tailed test. 

The difference between structure practice and eclectic practice groups 
a gain showed chance fluctuation with a probability greater than .50. 

A test of oral ability was also administered at the end of the second 
semester. Because of time limitations and the difficulty of evaluating 
large numbers of pupils, testing was restricted to the five '•pure'* groups, 
i.e., those who followed the same practice through the complete year. 

Forty pupils were randomly selected from each group, giving a total N of 200. 

The test consisted of three parts: phonetic accuracy, structure, and 
fluency. Phonetic accuracy was defined as the pupil's ability to pronounce 
Spanish sounds properly, structure as his ability to place language elements 
•in their proper syntatic order, and fluency as his ability to use the language 
to converse and to describe a simple scene. The maximum number of points on 
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the test for each section were; 20 for phonetic accuracy, 4 for structure, 
and 32 for fluency. 

Table 17 gives group means on each part of the test plus a total score 
which is a sum of the parts. 



Table 17 

GROUP MEANS ON SEPARATE PARTS 
OF THE ORAL TEST 



Group 


Test Part 


Phonetic 

Accuracy 


Structure 


» 

Fluency 


1 

^ Total 


1 


17.60 


1.48 


4.18 


23.26 


2 


18.33 


2.30 


8.98 


29.61 


3 


18.85 


2.56 


8.33 


29.74 


4 


18.98 


2.55 


9.60 


1 31.13 


5 


19.22 


2.41 


6.29 


i 27.93 


! Total 


18.60 


2.26 


7.48 


I 28.34 



The results are generally consistent with the listening comprehension 
tests. On total score, the groups ranked exactly the same as they did on 
each of the other tests, auid the results are approximately the same on struc 
ture and fluency. The only major chauige occurred on phonetic accuracy. 

Here groups one through four are in the same order, but group five (the 
parent help pupils) has moved to the front. 

A high relationship between speeiking ability and listening compre- 
hension is suggested by table 17* Pearson product moment correlations be- 
tween the second semester listening comprehension test and each part of the 
oral test are as follows: phonetic accuracy, .358; structu'e, . 088 : fluency 

jS80; and total score, .713* Though all the correlations are positive, even 
the .713 for total score leaves about 50 percent of the variance not 
accounted for by listening comprehension. To a large extent a different 
skill is being measured. 
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Critical ratios of differences between group means, with the .05, .01, 
and .001 levels of significance indicated, are given in table l8. 



Table l8 



CRITICAL RATIOS OF DIFFERENCES BETV/EEN GROUP MEANS 
ON THE ORAL TEST, BY TEST PART 



Groups 


Test Part 


Phonetic 

Accuracy 


Structure 


Fluency 


Total 


2-1 


1.21 


2.00* 


3.17** 


3.19** 


3-1 


2.09* 


2.93** 


3.53*** 


3.99*** 


4-1 


2 . 28 * 


2.90** 


3.76*** 


4.33*** 


3-2 


1.33 


0.62 


0.39 


0.13 


4-2 


1.62 


0.60 


0.33 


0.8l 


5 - 1 


2.95** 


2 . 62 ** 


2 . 08 * 


3.30*** 


1 


0.77 


0.39 


2.24 


1.83 


3-5 


1.23 


0.41 


1.67 


1.12 


2-5 


2 . 82 ** 


0.27 


1.74 


0.78 




0.33 


0.01 


0.80 


0.78 



♦P < .05 
**P < .01 
♦**P < .001 



c . Causal Factors 

Related to Double Vie.-n.ng and Parent Help 
As mentioned before, calendars were given to pupils who viewed the lesson 
again at night (with or without parental participation) and they were told to 
indicate the number of evening telecasts viewed and the number of minutes 
spent practicing with parents each week. The calendars were examined in an 
attempt to isolate the influence of evening activities on amoimt learned. 

Since only a limited number of the calendars were returned, the validity of 
broad conclusions based on them may be questioned. The returned calendars 
did offer some suggestions, however. The meaui test score of those children 
whose parents returned calendars was over three points higher than that of 
the groups as a whole, for example. This indicates outstanding achievement 



by this part of the parent group, but it also poses many questions for 
further study. 

Table 19 shows the average percent of evening programs watched by the 
evening viewing alone and evening viewing plus parent help groups the first 
semester. 



Table 19 

AVERAGE PERCENT OF EVENING PROGRAMS WATCHED THE FIRST 
SEMESTER BY EVENING VIE»;/ING AND PARENT HELP GROUPS 



Period 


1 

Evening 

Viewing 


\ 

Parent 

Help 


Prior to First 
Semester Mid-Term 


62.079^ 


72.515^ 


Complete Semester 




67.32S6 



Table 19 reveals that the parent help group watched the evening telecast 
about ten percent more in each period than the evening viewing group, and 
this could account to some degree for the superior learning of those vdth 
parent help. Whether or not this is true, however, depends on the relation- 
ship between evening viewing and test score. The product moment correlation 
betwc. .1 these variables was .289 for parent help pupils and . 15 ^ for evening 
viewing pupils, so the percent of programs watched accounted in part, at 
least, for the difference in performance of the two groups. 

Table 19 also shows that both groups watched the evening lessons con- 
siderably less in the period between tests than they did prior to the mid- 
term. This is not surprising since the Christmas season, a period when many 
regular activities are interrupted, occurred between the tests. The decrease 
in viewing could, in fact, account for the relative drop in performance 
(indicated by tables 8 and 9) by parent help pupils on the first semester 
final. A drop in performance of the evening viewing pupils is also suggested, 
and this did not occur. However, correlations in the preceding paragrap:. 



show that watching the evening lessons had a greater effect on parent help 
pupils than on the others, so results are generally consistent. 

Just why the telecasts had more effect on parent help pupils is unde- 
termined. Evidently the presence of parents during the viewirxg at home 
was motivating in some way. Motivation is also suggested by the larger 
percent of watching. 

Test means, adjusted for evening viewing, turn out to be about the 
same for both groups. The superior first semester showing of the parent 
help group, then, appears to be largely the results of viewing the lessons 
with parents. This means, however, that practice with parents had little 
effect. Table 20 verifies this conclusion. 

Table 20 



MEAN HOME PRACTICE TIME AND CORRELATION BETVffi^ 
PRACTICE TIME AND TEST SCORE THE FIRST SEMESTldl 
FOR THE PARENT HELP GROUP 



r 

Period 


Correlation 


Average Minutes 
Practiced per Week 


Prior to First 
Semester Mid-Term 


.030 


19.83 


Complete Semester 


-.023 


30.46 



\ near-zero correlation was found between practice time and test score. 
This does not mean, however, that practice time had no indirect effect. As 
mentioned above , increased motivation is apparent in these results , and 
family practice undoubtedly contributed to it. Unfortunately, this must 
remain an assumption since there is no direct way to measure motivation. 

Second semester figures give similar results, although the classroom 
practice plus evening viewing pupils continue to defy explanation. Table 
21 shows average percent of programs watched and the correlation between 
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programs watched and test score for groups with evening activities during the 
second semester. 



Table 21 

AVERAGE PER CENT OF EVENING PROGRAMS WATCHED 
AND CORRELATION BETWEEN PROGRAMS WATCHED AND TEST SCORE 

DURING THE SECOND SEI'iESTER 



Group 


1 Per cent of 

1 Programs Watched 
1 — _ 


Correlation i 


Evening Viewing 


1 

47.42^ 


.201 


Parent Help 


60.469^ 


.256 


Evening Viewing + 
Classroom Practice 


49.01% 


.254 


Parent Help + 
Classroom Practice 


60 . 38 % 


.082 



The groups without parent participation watched almost the same percent 
of programs and those with parent participation also watched the same percent. 
The correlation between programs watched and test score remained about the 
same for the parent help group as it was the first semester. For the even- 
ing viewing group it came up a little, and for the parent help plus class 
room practice group it dropped considerably. The drop was expected, since 
classroom practice entered as a new factor. The high correlation for the 
evening viewing plus classroom practice group is surprising. Since these 
pupils watched about half of the programs, the correlation should mean a 
better performance than those with classroom practice alone; however, 

table 12 shows a slight decrease in learning. 

Table 22 shows an increase in the relationship between practice time 
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and test score for parent help pupils during the second semester. 



Table 22 



MEAN HOME PRACTICE TIME AND CORRELATION BETWEEN 
PRACTICE TIME AND TEST SCORE FOR PARENT HELP GROUPS 
DURING THE SECOND SEMESTER 



1 

Group { 

i 


Correlation 


Average Minutes 
Practiced per Vfeek 




No Classroom Practice 


.220 


7.59 


Classroom Practice 


.170 

i 


17.70 

1 



The correlation between practice time and performance was much higher 
than during the first semester. Perhaps parents euid children had learned 
to work together more usefully; they were given additional information on 
practice procedures, auid this could have helped. At any rate, the higher 
correlation is encouraging. If it should continue as a trend, the value 
of parent help would increase from year to year. 

Parent help pupils without classroom practice registered a sharp drop 
in weekly amount of practice time compared to the first semester. Those 
with classroom practice showed a small drop but continued to practice over 
twice as much as the others, indicating that the classroom work encouraged 
more home activity. 



d. Summary of Findings 

The euialyses reported in this section may be summarized as follows: 
1. Two viewings of the television (i.e., repetition) are signi- 
ficantly superior to a single viewing. 

Dialogue classroom practice, used in conjunction with the tele- 
vision series, is significantly less effective than eclectic 
classroom practice. 
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3. Eclectic classroom practice appears to be superior to structure 
classroom practice, although differences between means for these 
groups were not statistically significant. 

4. Watching the television program again at night and having parent 
help is significantly superior to only watching again at night. 

5. Each of the classroom practices is significantly superior to a 
second viewing and parent help at night but no classroom practice. 

6. Combining classroom practice with a second viewing and parent help 
is significantly better than any other type of instructional 
pattern used. 

7. Combining classroom practice with a second viewing at night (but 

no parent help) is not significantly different from classroom prac- 
tice alone. In fact, groups with the evening viewing made scores 
slightly lower than those with classroom practice alone (no signi- 
ficant difference, however). 

8. Pupils with parent help learn more from just watching the TV lesson 
again at night than do pupils without parent help, and they watch a 
larger percent of programs. This carries strong implications of a 
motivational effect connected with parent help. 

9« The value of home practice with parents (exclusive of TV viewing) 
appears to increase with time. 

IV. DISCUSSION OF FINDINGS 
AND OF FUTURE PLANS 

The first year's research, to some extent at least, tested all of the 
hypotheses stated on page three, and in each case the hypothesis was 
verified. 

Hypothesis one stated that instructional television reinforced by class- 
room activities would be more effective than television alone. On every 
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evaluation during the year, the pupils with classroom practice learned 
significantly more than those without classroom practice. 

Hypothesis two stated that home activities would increase the amount 
learned from television, and again every evaluation showed those with home 
activities had learned significantly more than those who merely viewed 
television once during school. 

The conclusiveness of these results means that researcn related to the 
first two hypotheses may be considered complete. Large differences, with 

probabilities consistently less than .001, leave no doubt of the validity 
of findings. 

Though hypotheses three and four were partially verified, a number of 
important questions related to them remain unanswered. 

Hypothesis three, for example, stated: "Instructional television of 

a certain kind, reinforced by certain home and classroom activities, makes 
for more learning, ceteris paribus, than without these reinforcements or 
with either one alone." Classroom practice combined with evening viewing 
and parent help did prove significantly better during the second semester 
than anything else tried, and it supports the hypothesis. On the other 
hand, one would expect the combination of classroom practice and evening 
viewing also to support the hypothesis, but it did not. The reasons for 
this must be determined before any final conclusions regarding the most 
effective combination of classroom practice and home activities can be 
drawn. In addition, certain types of activities are yet to be tried. 

This leads to hypothesis four, which states that certain kinds of home 
and classroom activities will be more effective than other kinds and com- 
binations when used as reinforcement for instructional television. As far 
as the research has gone, hypothesis four holds. Eclectic classroom practice 
appears to be the most effective classroom activity; watching the evening 
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telecast with parents and practicing with them is definitely more effective 
as a home activity than merely watching; and combining a classroom activity 
with evening viewing and parent help is more effective than any other com- 



bination or any single activity. 

These results are not conclusive because of the number of possibilities 
to be tried during the remaining two years of research. Some of these are 
completely new eind some are practices and combinations based on findings 
to date. 

Regarding the latter, eclectic has been chosen for use in all class- 
rooms and dialogue drill and structure drill eliminated as single methods. 
Parent help materials have been improved, largely along lines suggested by 
the first year's participeuits, and the method has been broadened so that any 
parent in any group may volunteer. Every pupil in the project will be en- 
couraged to participate in some home activity in addition to classroom 
procedures. 

New activities include the use of electronic aids such as tape recorders 
and record players. During the second year of instruction (sixth grade) pupils 
will learn to read and write the Spanish already covered thoroughly by the 
audio-lingual method and will engage in in-school activities not necessarily 
limited to the classroom. The in-school activities might include such things 
as a Spanish table in the lunchroom, Spanish games on the playground, and a 
Spanish alcove where items of cultural interest would be displayed. 

The research design for the project will continue to be determined in 
the manner so far utilized. That is, the procedures used each year will be 
based upon previous results to a large extent, but always with efforts 
toward discovering more effective and refined activities. 

This report covers approximately one- third of the time allotted to the 
project. Results of the remaining research will be made available as soon 
as possible after each school year. 
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SUMMARY 



The Problem 



Pifth grade pupils in the Denver-Stanford project study Spanish entirely 
by the audio-lingual method. At sixth grade, however, they learn to read end 
write the vocabulary and functional grammar used orally the first year. 

Project personnel have sought to auiswer two major questions relative to 
development of the reading and writing skills. First, when is the best time 
to begin reading and writing instruction? Foreign language e3q>erts disagree 
as to whether this instruction should be introduced at the beginning of sixth 
grade or at the beginning of the second semester. Second, what is the best 
method for teaching reading and writing? Could it be handed best through 
the traditional teacher-directed approach or through the newer medium of 
automated instruction? 



Results 



Sixth grade pupils were randomly divided into two groups. The first group 
started reading and v/riting at the beginning of the first s^ester, and the 
second group staurted at the beginning of the second semester. These groups 
were, in turn, randomly divided, and half of each studied reading and vrriting 
throu^ autojiated instruction, vdiile the other half studied throu^ the 
traditional teacher-directed approach. 

Concerning the best time to begin reading and writing instruction, pupils 
who had this instruction tne first semester performed better on tests of under- 
standing and speaking sld.lls at the end of the semester than pupils who did 
not have reading and v/riting. And, at the end of the year, pupils vdth read- 
ing and \tfriting the first semester again performed significantly better on 
understanding and speaking tests than pupils who started reading and writing 
the second semester. Since the objection to starting reading and writing at 
the beginning of the yeau:* was based on the fear that it would adversely affect 
the speaking skills, and obtained results showed this definitely did not occur, 
the earlier beginning of reading and writing instruction appears desirable. 



The comparison of teaching methods was based on relative performances 
on a test of reading and writing skills. At the end of the first semester, 
pupils with the teacher-directed approach performed significantly better than 
those with automated instruction. At the end of the second semester, however, 
there was no significant difference between pupils who studied by the different 
methods. This was true for pupils who started reading and writing at the be- 
ginning of the year and for those who started the second semester. (Second 
semester results for the former group were adjusted by the covariance technique 
for first semester performance, so that only the amount learned during the 
second semester was reflected.) These results suggest an important timing 
effect in the use of automated instruction. Any automated program must neces- 
sarily assume a certedn prior knowledge, and, for the program to be most effect- 
ive, users must possess this knowledge. A teacher can make individual adjustments 
if a pupil is not fully prepsured for the instruction at hand, but an automated 
program cannot. Within this limitation, automated instruction can be highly 
effective. 

Another finding relative to the automated instruction was that the training 
and experience of the classroom teacher who taught the audio-lingual skills nad 
a significant effect on the amount pupils learned from automated instruction in 
reading and writing. In automated instruction, pupils are on their own to a 
great extent, and their desire to learn largely determines what they do. Thus 
the classroom teacher, who has a great effect on this desire, helps determine 
the performance of pupils in automated instruction. 

Finally, two versions of the automated materials were used. Each was a 
linear program and used the same frames, but the sequence of frames was different. 
One sequence used what were apparently minimum learning steps, while the other 
used larger learning steps. The sequence with minimum learning steps produced 
significantly fewer response errors, took significantly less time to complete, 
and produced significantly superior results on the reading and writing test. 
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The Denver Public Schools and Stanford University's 
Institute for C(»ununication Research aa*e currently engaged 
in a joint reseaurch project on the context of instructional 
television. The purpose of the pioject is to learn how 
instructional television can best fit into the total teach- 
ing situation. A substantial amount of research has estab- 
lished that television is a very effective teaching medium. 
W^s of combining it with other educational activities must 
now be considered, and the Denver-Stanford project is a 
beginning effort in this direction. Kenneth E. Oberholtzer 
is principal investigator for the Denver Public Schools 
and Wilbur Schramm is principsJ. investigator for Stamford 
University. This is one of a number of project progress 
reports. 



The Denver-Stanford project is concerned with teaching be ginning 
Spanish to some 12,000 fifth amd sixth grade pupils. All pupils view tele- 
vised Spanish lessons and engage in teacher-directed classroom activities 
designed to complement the TV lessons. 

In keeping with current methodology in elementary school foreign 
language instruction, audio-lingual practice is used exclusively during the 
first year of study (fifth grade). During the second year (sixth grade) the 
development of audio-lingual skills is continued, but reading ai:'l writing are 
a0.so introduced. The vocabulary and functional graunmar used in reading and 
writing are limited to material, which is taught audio-linguadly in the fifth 
grade and with which pupils have orauL facility. 

Project personnel have sought to amswer two major questions related to 
reading and writing instruction. First, when is the best time to introduce 
reading and writing — at the begirming of sixth grade after two semesters of 
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exclusive audio-lingual work or at the beginning of the second semester of 
sixth grade when pupils have worked three semesters exclusively on the develop- 
ment of understanding and speaking skills? This question is cogent because 
the speaking skills, especially, can be adversely affected if pupils see the 
written word too soon. A premature introduction of reading and writing can 
lead to anglicization. 

The second question concerns the best method of teaching reading and 
writing. Traditionally, reading and writing instruction has been handled by 
the classroom teacher in a face-to-face, group-learning situation. The tra- 
ditional method has proved effective over many years, of course. The recent 
development of automated instruction and the dramatic experimental results it 
has produced, however, raise the question as to whether the reading and writing 
instruction given in the Denver-Stanford project could not be handled as effec- 
tively through the automated approach as with teacher-direction. 

Both programed auad conventional reading-and- writing texts were developed 
during the 196 O- 6 I school year so that a comparison of the two instruction 
methods could be made. The development process is described in a previous 
report (1). 

This report deals with reading and writing results during the second 
year of research in the Denver-Stanford project — the 1963-62 school year. 

Research Design for Reading and V/riting 

At the beginning of the year, sixth grade pupils were divided into two 
groups, each consisting of approximately 90 classes with some 3*000 pupils. 

One group started reading and writing at the beginning of the school year, 
while the other group started at the beginning of the second semester. This 

I division was to allow evsJ. nation of different starting times for reading and 

writing instruction. 

I 

I Each of the two major groups was in turn subdivided into two parts, with 
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one Subgroup learning to read and write throu^ the traditional teacher- 
directed method and the other learning through automated instruction » Pro- 
gramed textbooks were used by all pupils receiving automated instruction 
during the first semester and by all but four classes during the second 
semester. These four classes used a commercially-manufactured teaching 
machine. 

Two versions of Automated Spanish i the panel text, were used. The 
first — the I-II series — consisted of the original arrangement of frames 
which was developed through work with individual pupils; the second — the 
A-B series — was a different arrangement of the original frames based on 
suggestions by staff members of the Center for Programed Instruction. The 
A-B series was less sequential than the I-II series, and it therefore in- 
volved larger learning steps. 

This research design allowed answers to these questions: 

1. Does the introduction of reading and writing, after only one year 
of audio-lingual instruction, have any effect on the listening and 
speaking skills of pupils? 

2. How does automated instruction of reading and writing compare vdth 
instruction by the more traditional teacher-directed method. 

3* In automated instruction, do pupils learn more from a minimum stop 
sequence of frames, or do they learn more from a larger step but 
supposedly more interesting sequence? 

Measuring Instruments 

Two reading and writing tests, final exams for each semester, were de- 
veloped for this phause of the study. As given, the 66-item first semester 
final had an average biserial correlation (the index of discrimination) of 
.713 and a split-half reliability of .938, The second semester final, with 
50 items, had an average biserial correlation of .593 and a split-half re- 
liability of .957» The Pearson product moment correlation with listening 
comprehension tests was -634 for the first semester final and .684 for the 




second semester final. 
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As mentioned in an earlier report, a training and experience questionnaire 
was completed by all classroom teachers during the second semester. On this 
questionnaire, teachers indicated their foreign language courses in high school 
and college, their years of experience in teaching foreign leinguage, any foreign 
language workshops they had attended, and any experience either in a bilingual 
home or in a foreign country with another language. 

In developing a scale from questionnaire results, fifth grade teachers 
were used, and the first semester listening comprehension results from their 
classes constituted the criterion- These teachers were rauidomly divided, and 
half of then were used in the scale development. The scale was then cross- 
validated v/ith the other half of the teachers. 

Formal training was arranged in five categories as follows: 

1 = none 

2 - a foreign language other than Spanish in high school but no 

further training 

3 = Spanish in high school but no further training 

4 «a one year of foreign language in college 

5 = two or more years of foreign language in college 

Experience was arranged in the following three categories: 

1 = none 

2 = taught Spanish on^ or two years or taught French one or more 

years 

3 = taught Spanish three or more years 

And vorkshop attendance was arranged in two categories: 

0 = have never attended a foreign language workshop 

1 = have attended one or more foreign language workshops 

In deriving a scale score for each teacher, formal training was weighted 
three, experience was weighted one, and workshop attendance was weighted one. 
The scores, therefore, had a possible range of 5 to 20. Bilingual experience 
did not seem to have any effect on pupil performance and was not used in the 
scale. 

Teachers were assigned scale scores and T^hen arranged in three groups, 
which were classified low (5 to 8 scale points), middle (9 to l4 scale points). 
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and high (15 to 20 scale points) on training and experience. The efficacy of 
the scale is demonstrated in table 1, which gives mean scores of fifth and 
sixth grade pupils on second semester tests. 



Table 1 



performance of pupils 

WHEN CLASSIFIED ACCORDING TO 
THE TRAINING AND EXPERIENCE OF THEIR TEACHERS 



Teacher High 
Training 
and 

Experience Low 



Fifth Grade 
Listening 
Comprehension 

36.750 

35.231 

33.069 



Test 

Sixth Grade 
Listening 
Comprehension 

32.671 
32.049 
31 *154 



Sixth Grade 
Reading and 
Writing 

18.049 

15.579 

12.636 



All differences between vertical 



categories in table 1 are significant 



beyond the .05 level. 



Results 

The First Semester 
a. Comparison ox Learning Methods 

First semester results were analyzed by a one-dimensional covariance 
analysis in which the 66-item final was the dependent variable, and grade point 
average, IQ, reading and writing pre-test, and listening comprehension pre-test 
were control variables. The six groups compared, with number of subjects from 

each group in the analysis are shown in table 2. 

It will be recalled that the I-II series was the sequence of frames 
originally developed, and the A-B series was the changed sequence based on 
suggestions by the Center for Programed Instruction. The changed sequence was 
suggested as a means of testing the point of view that a larger learning step 
would prove more interesting and would therefore be a more effective teaching 

medium, at least for some pupils. 
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Table 2 

EXPERIMENTAL GROUPS AND 
NUMBERS OF SUBJECTS 

IN ANALYSIS OF READING AND WRITING TEST 

Experimental Group Number of Subjects 

in Analysis 



Aut(xnated, Book 1 








(A^) 


93 


Automated, Book A 








(Aa> 


169 


Teacher-Directed 








(TD) 


193 


Automated, Book 1 


+ 


Electronic 


Aids 


(A^+EA) 


277 


Automated, Book A 


+ 


Electronic 


Aids 


(A^+EA) 


171 


Teacher-Directed 


+ 


Electronic 


Aids 


(TD+EA) 


222 










Total 


1125 



Adjusted test means plus standard deviations and variances are given in 
table 3 * 



Table 3 

ADJUSTED TEST MEANS, 
STANDARD DEVIATIONS, AND VARIANCES 
FOR EACH EXPERIMENTAL GROUP 



Group 





Autcxnatod^ 


Automated. 

A 


Teacher- 

Directed 


Automated .4 Automated^+ 
Electronics Electronics 


Teachcr- 

Directed-I' 

Electronics 


Reading and 
Writing Test 


17.001 


13.725 


17-665 


18.020 


16.132 


22.IC7 


a 


14.077 


12.048 


14.097 


12.492 


12.328 


17.077 


o2 


198.167 


145.167 


198.745 


156.071 


151.985 


291.646 



Results of the covariance analysis of these data are given in table 4 . The 
probability of less than .001 indicates that real differences occurred among the 
groups, and group comparisons are in order. The test means in table 3 shov; r. 
very consistent pattern. In each case the I-II series is superior to the A- •> 
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series; teacher-directed reading and writing is superior to the programed texts 
and those with electronic aids did better than similar groups without electronic 
aids. Tests of the significance of differences between groups are given in 
table 



Table 4 

COVARIANCE ANALYSIS C? DIFFERENCES 
BETVEEtf EXPERIMENTAL GROUPS 
ON THE READING AND WRITING TEST 



Source of 
Variation 






Residual 






DF 


Sums of 
Squares 


Mean 

Square 


Total 




1120 


82 , 139.767 




Within 

Groups 




1115 


76,605.807 


68.705 


Between 

Groups 




5 


5,533.960 


1,106.792 




r 


1 . 106.792 

= es:^ ‘ 






= 5 


"2 

P< .001 


* 1 U 5 



Table 3 

SIGNIFICANCE OF GROUP DIFFERENCES 
ON THE READING AND WRITING TEST 



Groups 


Difference 




CR 


P 


Automated^ - 

AutomatedT 

A 


1.834 


0.949 


1.933 


<.06 


Teacher-directed - 
Automated 


3.189 


0.918 


3.474 


<.001 


Electronic Aids - 
No Electronic Aids 


2.101 


0.869 


2.418 


<.02 



These results leave no doubt that pupils %fith the teacher-directed method 
learned more during the first semester. Several other questions need consider- 
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atlon before any final conclusions can be drawn « however. Would these results be 
consistent for teachers with limited training and experience as well as for well- 
trained teachers? What would a comparison between pupils of different IQ levels 
show? What about the pupils who worked rapidly through the automated books as 
compared to those who worked slowly? 

Rather surprising was the finding that electronic aids seemed to help pupils 
learn Spanish reading and writing. The electronic aids were eaqpected to improve 
listening and speaking skills but not reading and writing. 

Finally, the original sequence of frames apparently worked better than the 
larger-step sequence proposed by CPI. 

Means for the combined groups were: I-II series — 17 • 764; A-B series — 

15-930; all automated — 16.885; teacher-directed ~ 20.074; electronic aids — 
18 . 893 ; no electronic aids — 16.792. 

b. Characteristics of the Automated Programs 

Extensive records were kept during the first semester so that such charac- 
teristics of the programs as error rate and time rate could be examined. An 
analysis of these data indicates that the rearrangement of frames did indeed 

make a difference in pupil performance on the programs. 

% 

Regarding error rate, the original sequence (the I-II series) was written so 
that pupils made as few errors as possible. That is, a minimum error rate was 
sou^t. The altered sequence proposed by CPI (the A-B series) involved larger 
learning steps between some frames, and the error rate was therefore eaqaected to 
increase, though there was no assurance that it would. 

The A-B series, in fact, did have a higher error rate. Pupils with this 
book made an average of 47.648 errors in completing their first 672 frames for 
an error rate of .071. Pupils usi <g the I-II series on the other hand, averaged 
36*353 errors on the same number of frames for a rate of .057. The difference of 
9 . 295 * with ss 3-520, gave a critical ratio of 2.641, which is significant 

er|c 
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beyond the .01 level. In other words, the A-B series had a significantly 
higher error rate than the I-II series. This is clearly seen in table 6; more 
than twice as many of the I-II's made four errors or less than did the A-B's, 
while more than twice as many A-B's than I-II's made more than 150 errors. 

Table 6 

ERROR DISTRIBUTION AMONG 
BOOK I AND BOOK A PUPILS 

Number of Pupils Making This Many Errors 



Errors Book I Book A 

0-4 16.356 7.796 

5-9 8.7 10-^ 

10 - 49 ^9«6 51 «5 

50 - 99 17.8 17»^ 

100 - i49 5«5 7.5 

More than 150 2.0 5»6 



100.056 100.096 

(N) (343) (^3) 



The range in error rates was surprisin^y large. A few pupils made no 
errors (they did not mark any, at least), while almost two percent made more 
than 200. One child marked himself wrong 351 times as he went throng the first 

672 frames, giving him an error rate of .522. 

Error rate correlated -.285 with results of the first semester final test 
— that is, p»q)ils with lower error rates tended to make higher grades on the 
test. Though one must he cautious in ascribing cause and effect, this negative 
relationship fits neatly into the pattern so far observed. The A-B series pro- 
duced more errors than the I-II series; pupils with fewer errors tend to ak 
higher scores; and, as would be predicted, the I-II’s learned significantly more 
than the A-B’s. This suggests that, as Skinner and his foUowers have held, a 

minimum error rate is desirable. 

A wide range was also found in the amount of time required to complete the 
first book (672 frames). One pupU finished on November 11, only seven weeks 
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after starting the program; while two pupils did not finish until April 11, 
after 26 weeks. Since all pupils used the automated texts only in class, for 
a standard work period of 30 minutes a week, these ccxnpletion times represent 
a range from to 13 hours required to work through the first book. 

With this wide range in working time, pupils will obviously require 
widely different amounts of materials in a school year. For all pupils, the 
average number of weeks required for the first book was 14.03, so three books 
would suffice for a 36 week year on the average. However, 24.5 percent of the 
pupils finished in 11 weeks or less and would require more than three books, 
and 1.5 percent finished in less than nine weeks and could use a fifth book. 

Book I and Book A required different amounts of time for completion. For 
Book I, 13 • 688 weeks were required; whereas, 14.338 weeks were required for 
Book A. The difference, .650 weeks or about 19*3 minutes working time, gave 
a critical ratio of 1.947, which is significant at about the .05 level. 

Length of time required to complete the first book, like error rate, 
showed a significant negative correlation (-.255) with test score. Table 7 
shows this relationship cleairly. 

Table 7 

MEAN SCORES OF PUPILS 
WHO COMPLETED THE FIRST BOOK 
AT DIFFERENT TIMES 



Weeks Spent 
On First Book 


Percent 
In This 


of Pupils 
Category 


Mean Score on 
First Semester Test 




Book I 


Book A 


Book I 


Book A 


11 or less 


28.69^ 


21.796 


20.292 


18. 743 


12 - 13 


22.6 


27.3 


15.158 


14 . 68 a 


14 - 16 


33.3 


27.3 


14.018 


14.909 


17 or more 


15.5 


23.6 


7.615 


9.3^2 




100.096 


100.096 







The correlation between time and score may be somewhat spurious, of ccrurse, 
because some pupils did not complete all material covered in the test. 




Less 




than 25 percent fell in this category, however, and the top three categories in 
table 7 still show a strong relationship. Even if failure to complete part of 
the work is a contributing factor, the time requirement is still important; if 
two programs can teach the same amount, the one requiring less time would seem 
desirable. 

Both the correlations of error rate with test score and time with test 
score might be caused by a third variable — ability. That is, more able pupils 
might take less time and make fewer errors, and the relationships found would 
therefore be merely reflections of the correlation between ability and test score. 
In this case, time and error rate would be measures of the same thing and would 
correlate highly with each other. But since the correlation between error rate 
and time required was only .l67» they are not just separate indicators of abil- 
ity. The multiple correlation of error rate and time required with test score 
is -.355, which represents a significant increase over either variable used 
fii yigl y in amount of variance accounted for. (Using the F ratio test on page 
279 of McNemar's Psychological Statistics , the increase in correlation was 

significant beyond the .001 level.) 

These results, we believe, make a strong case for the linear, minimum 

learning step sequence as used in Book I. 

The Second Semester 

During the second semester, pupils who began reading and writing at the 
start of the year continued with their respective methods, and the remainder 
of the sixth graders began reading and writing. As previously mentioned, the 
new pupils were divided into automated and teacher-directed groups and a new 
comparison was possible since four classes from the automated group actually 
worked with teaching machines. 

In addition, the completion and administration of the teacher training and 
experience scale made a much more comprehensive analysis possible at the end of 
the year. Second semester results, divided into three teacher training and 



experience groups , are shown in tables 8 and 9* The reader should remember 
that these tables show results of different tests* Pupils who began reading 
and writing the second semester took the 66-item first semester final at the 
end of the year, while those who began at the start of the year took the 50” 
item second semester final* Also, these tables reflect only second semester 
learning; results in table 8 are adjusted for the first semester final* 

Both tables show the marked effect of teacher training and experience on 
learning. Differences on this variable produced an F ratio of 7.650 for table 8 
and 10.613 for table 9, and with of 2 and of 696 and 952 respectively, 
both F ratios are significant far beyond the *001 level. Even more interest- 
ing is the fact that this effect holds among the automated pupils, except for 
those who actually used a teaching machine* 

Both analyses eG.so produced interactions significant beyond the *05 level* 
The source of the interaction is the horizontal dimension in table 8. That is, 
results are consistent vertically but inconsistent horizontally* Among pupils 
with teachers high on the tradning and experience scale, the teacher-directed 
method was best; but for pupils with teachers low on the scale automated in- 
struction was best. This outcome seems entirely reasonable, and the tempta- 
tion is strong to accept it as a general principle. Table 9 precludes such 
acceptauice, however. 

Table 8 

ADJUSTED MEAN SCORES OF PUPILS 
WHO STARTED READING AND vmiTING THE FIRST SEMESTER — 

ARRANGED BY LEARNING METHOD AND BY TEACHER TRAINING AND EXPERIENCE 









Learning Method 








Automated 

Text 


Teacher- 

Directed 


Total 


Teacher 


High 


15.174 


16.598 


15.753 


Training 

and 


Middle 


14.882 


15.146 


14.997 


Experience 


Low 


14.758 


12.609 


15.672 




Total 


15.081 


15.741 


15.361 
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Table 9 

ADJUSTED MEAN SCORES OF PUPILS 
\fflO STARTED READING AND liRITING THE SECOND SEMESTER — 
ARRANGED BY LEARNING METHOD AND BY TEACHER TRAINING AND EXPERIENCE 









Learning Method 




Automated 
Text Machine 


Teacher- 

Directed 


Total 


Teacher 


High 


iS .348 


16.681 


16.526 


17.619 


Training 

and 


Middle 


15.227 


19.288 


13.99^ 


14.993 


Experience 


Low 


12.763 


20,036 


17.112 


14.812 




Total 


16 Aik 


18.439 


15.447 


16.165 



In table 9 , both dimensions contribute to the interaction. Teacher 
training and experience has no clear-cut effect on teacher-directed pupils, 
and it reverses the order for teaching machine pupils — those vdth the best 
trained teachers did poorest and vice-versa. In addition, the comparison of 
automated text and teacher-directed pupils shows a reversed effect from table 8. 
Here the automated pupils did best when teachers were high on the training and 
experience scale, while teacher-directed pupils did best when teachers were 
low on the scale. So the suggestion in table 8 that automated instruction 
will show up best when compared to the work of less-well-trained teachers fails 

to hold up. 

The teaching machine result in table 9 was very surprising to project 
personnel. The particular model used broke down consistently, and the children 
appeared to be repairing their machines at least a quarter of the time. In 
spite of this, children with the machines did significantly better (P < . 001 ) 
overall than the others, and the breakdown by training and experience shows 
them better in every comparison except one (versus the automated text in the 
high category). This could be the result of "gimmick value," with the novelty 
of the situation stimulating learning for the relatively short period of the 
study. Or it could be that control of the responses made the difference, that 




it is important to prevent the possibility of seeing correct answers before 
responding overtly. 

Finally, in both cases represented by tables 8 and 9i no significant dif- 
ference occurred between pupils who learned from the automated texts and those 
who were teacher-directed. This is in sharp contrast to the first semester 
when teacher-directed pupils did far better than the others, and it suggests 
that timing was a very important factor in determining the relative merits of 
the two learning methods. In fact, timing could help account for the differing 
effects of teacher training, a point which will be discussed later. 

First, however, consider the influence of IQ on the separate learning 
methods. Tables 10 and 11 show the results for both second semester and begin- 
ning pupils when airrauiged in high, middle, amd low I(Q groups. 

Table 10 

ADJUSTED MEAN SCORES OF PUPILS WHO STARTED 
READING AND WRITING THE FIRST SEMESTER 
ARRANGED BY LEARNING METHOD AND IQ 







Learning Method 


Automated 

Text 


Teacher- 

Directed 


Toteil 




High 


14.271 


16.005 


14.926 


IQ 


Middle 


14.558 


13.662 


14.198 




Lov/ 


1^'.314 


15.487 


14.687 




Total 


14.413 


14.706 


14.521 



In both tables significant differences occurred among the different IQ 
groups, and in both the comparison of learning methods produced the same results 
as tables 8 and 9 * (Overaill means here are slightly different from those in 
tables 8 and 9 because random withdrawals from groups to meet the proportional 
cell frequencies assumption resulted in slightly different samples.) Table 10 
produced an interaction significant at the .01 level, while there was no signif- 
icant interaction for table 11. 



Table 11 



ADJUSTED MEAN SCORES OF PUPILS VJHO STARTED 
READING AND WRITING THE SECOND SEt-^ESTER 





ARRANGED BY 


LEARNING METHOD 


>-D IQ 








Learning Method 




Automated 
Text Machine 


Teacher- 

Directed 


Total 


High 


20.786 


21.901 


19.695 


20.433 


IQ 


15.708 


18.391 


16.128 


16.024 


Low 


15.360 


15.860 


13.848 


14.799 


Total 


16.506 


18.949 


16.088 


16.471 



The interaction in table 10 suggests no clear-cut conclusion. Among 
automated pupils, the middle IQ group did best, while this group did poorest 
among the teacher-directed pupils. The inconsistency can be seen in another 
way: teacher-directed pupils did best in the high and low IQ groups, while 

automated pupils did best in the middle group. Vihatever these inconsistencies 
may mean, they do not support the finding from the English 2600 study that 
high IQ pupils learn more from automated instruction while low IQ pupils 
learn more when teacher-directed (2). Rather, IQ seems to have no overall 
effect except that higher IQ pupils generally do better with any form of 
instruction than lower IQ pupils. 

During the second semester, in contrast to the first, electronic aids had 
no effect on reading and writing test results. 

Discussion of Results 

Our results suggest a number of conclusions relative to the use of auto- 
mated instruction and to the teachi.ng of reading and writing in Spanish. 

First, we have definite indications that a linear, minimum learning step 
sequence is desirable for the type of learning involved here. When compared 
with a larger learning step sequence, the minimum sequence proved to produce 
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fewer response errors, to take less time, and to result in more learning. 

Another oonolusion is that, with proper conditions and at least with 
types of learning which require a good deal of routine, repetitive work, 
automated instruction can be as effective as the more traditional teacher- 
directed method. In fact, the teaching machine results suggest that auto- 
mated instruotion can be superior, though conditions for this superiority 

are uncertain e 

Timing appears important in determining the effectiveness of automated 
instruction. Our automated program assumed a certain prior knowledge at the 
audio-lingual level, and evidently many pupils did not possess this knowledge 
at the beginning of the first semester of sixth grade. Automated instruction 
proved less effective than teacher-directed instruction the first semester, 
but in two separate trials the two methods --re of equal effectiveness the 
second. The timing or prior knowledge effect becomes even more apparent when 
reading and writing results are arranged according to listening comprehension 
pre-test scores. This arrangement is demonstrated both in table 12 and in 
the graph which follows. 



Table 12 

FIRST SEMESTER READING AND WRITING 
RESULTS OF AUTOMATED INSTRUCTION PUPILS 
ARRANGED BY LISTENING COMPREHENSION PRE-TEST SCORES 



ning Comprehension 
e-Test Score 


Percent of 
Pupils 


Mean Score on 
Reading and Writing 


25 or less 


17.7% 


4.061 


26 - 30 


18.5 


6.277 


31 - 35 


22.2 


11.871 


36 - 40 


23.5 


19.421 


4 l - 45 


15.1 


26.587 


46 - 50 


3.0 


29.560 




100 . 0 % 










The graph shows that pupils vdth a score of 25 or less on the listening 
comprehension pre-test do not do well in reading and writing. Somewhere be- 
tween 25 and 30, however, the curve takes a sharp turn, and a small improvement 
in listening comprehension then makes a big difference in reading and writing. 

The slope decreases again at about the 45 level., 

The critical point, then, seems to be about 28 to 30. If pupils do not 
have sufficient knowledge at the audio-lingual level to score this high on the 
listening comprehension pre-test, they will profit little from our automated 
instruction. Above this point, however, automated instruction is very effective 
Since almost any automated program will of necessity assume some knowledge 
and pupils will attain this knowledge at different times, the timing effect 
could well have broad implications. If a single program is to be used for a 
subject area, it should probably be introduced to different levels of students 
at different times. If automated instruction is to begin for all students at 
the same time, on the other hand, different programs should be used for dif- 
ferent levels of students. In either case, the result would be a further 
separation among students in amount of knowledge possessed. 
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The difference in work rate, discussed in the section on first semester 
results, adds to this problem (if it is a problem). We found that some pupils 
would still be in the second book after one year’s work, while others would 
have finished six books. This is a ratio of more than three to one. Applied 
to several subject areas and allowed to continue unabated, this difference 
in rate of progress would certainly disrupt our present educational system. 

It would nc longer be possible to group pupils as first graders, second graders, 
etc . , and move them along from yeau* to year at the same general pace . In fact , 
little grouping would be possible, and teachers, instead of working in group 
learning situations, would work with pupils individually. 

To say we are not presently ready for this is an understatement. Yet, 
we have proved that automated instruction is effective, and we should use it. 
The question is ho%#? Obviously scmie modification of a strict automated 
approach is needed. 

In another comparison, we found that classroom teachers had an eifect on 
the amount pupils learned from automated instruction In this situation, where 
students progress at their own rates, they are almost entirely on their o%#n, 
ar.d motivation to learn must be of great importance. Motivation is a complex 
affair with many contributing factors, of course, but :here can be no doubt 
that the classroom teacher's contr?.bution is of major proportion. Among 
pupils who started reading and writing the second semester, those with the 
best— trained teachers learned more from the automated than the teacher— directed 
method, while those with less-well-trained teachers did not do as well with 
automated. Evidently the better-qualified teachers inspired their pupils to 
learn more, and this inspiration showed up clearly when automated instruction 
put the pupils on their own. 

Finally, the fact that many pupils were not ready for the automated 
materials at th?^ beginning of the year does not mean that they were not ready 
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to study reading and writing. Esther, two separate findings indicate they 
were ready. First, as we have reported previously, the reading and writing 
instruction had no adverse effect on either listening comprehension or speak- 
ing scores. And, second, the teacher-directed group did quite well the first 
semester; their mean reading and writing score was about 33 percent higher 
t: -hat of the automated pupils. So the classroom teachers, by adjusting 

instruction to the needs of the children, were able to do quite well at the 

beginning of the year. 

Overall, then, we have these results: automated instruction is effective 

when pupils are ready for it, teachers are also effective and can adjust the 
instruction to fit individual and group needs, and teachers affect the amount 
learned from the automated materials. This combination of findings suggests 
a possible solution to the problem posed above — namely, that teacher-directed 
and automated instruction should be used together. By assigning specific 
portions of a program either as class or homework while using the group learning 
situation regularly, a teacher should be able to increase the amount children 
learn in a given time and still move a heterogeneous group at roughly the 
same rate. Since we are investigating various combinations of automated and 
teacher-directed instruction this year, we should know more about this 
possibility in the near future. 
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SUMMARY 



The Problem 



During 1962-63, the last year of active research in the Denver-Stanford 
Project, work was continued at both the fifth and sixth grades. As in 
previous years, fifth grade instruction was concerned entirely with the 
development of listening and speaking skills— that is , it was entirely 
audio-lingual in nature. Audio-lingual instruction was continued at sixth 
grade, and, in addition, development of reading auid writing skills was 
begun. 

The reseourch at fifth grade was designed to determine, first, the value 
of certain electronic adds and, second, the most useful ways to incorporate 
these aids into the instructional process. Some children used no electronic 
aids. Some listened and responded to special lessons on record players and 
tape recorders but did not record their own voices. Still others both 
listened auid recorded their own voices. 

At sixth grade, the research was directed mainly toward evaluating 
methods of teaching reading and writing. Reading and writing was taught 
entirely by the traditional teacher-directed method, entirely by the auto- 
mated method (programed instruction) and by various combinations of ■* .ese two 
methods. Other activities included extended reading of simple Spanish 
materials and use of a ’’Spanish Comer,” in which was placed reading materials, 
electronic aids, and cultural artifacts. 

Finally, parent participation in the instructional process was con- 
tinued at both fifth and sixth grades. 



Resirlts 



Results at fifth grade suggested that electronic aids, especicJLly those 
with feedback (that is, where the child records and listens to his own voice), 
are a desirable addition to the classroom Spanish program. An exception to 
this occurs, for reasons so far unexplained, among children from homes where 
Spanish is spoken natively. These children are very few in number, however, 
so that the electronic aids appear potentially helpful to the great raajority 
of fifth grade pupils. 

The sixth grade results confirmed a previously stated hypothesis 
that a combination of automated and teacher-directed reading and writing 
instruction would be superior to either method alone. The combination 
produced significantly superior results on both listening con^rehension and 
reading and writing tests. Speaking test results showed the combination 
slightly less favorable, apparently because of less face-to-face contact 
between pupil and teacher when automated instruction is used. It appears, 
however, that this difficiency can be overcome through use of electronic 
aids outside of the regular Spanish instruction period. 
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special interest scales were used at sixth grade, and they showed that 
both teacher and pupil interest affect learning. Pupil interest related, 
as a dependent variable, to two factors. The stronger was pupil interest 
prior to the beginning of the school year, emphasizing the importance of 
the pupil's experience at fifth grade. The second factor was experimental 
treatment; pupil interest was higher under the conditions which provided 
some activity in addition to those of the regularly scheduled classroom 
period. Homework was one such additional activity. Teacher interest was 
found to interact with teacher experience and preparation in a most revealing 
manner. Where teacher interest was high, pupil performance was directly re- 
lated to teacher preparation and experience. But, where teacher interest 
was lov;, pupil performance v;as inversely related to teacher prepau:*ation 
and experience. 

Class size v/as considered and smaller classes proved advantageous only 
in those situations involving direct teacher instruction. 

Overall, the third year results reemphasized the importance of the 
classroom teacher, even v/hen the basic instruction is handled through 
television as in this project. A well trained amd hi^ly motivated class- 
roo::i teacher is undoubtedly the most effective single "lessening aid" that 
a school system can combine with instructional television. 

Finally, parent participation again proved a valuable addition to the 
instructional package at both fifth and sixth grades. Pupils whose parents 
worked \idth thorn learned significantly more Spanish than those vdiose parents 
did not participate o 
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THIRD YEAR RESULTS 
IN THE DENVER-STANFORD PROJECT 



by 

John L. Hayman, Jr, 
James T. Johnson, Jr. 



The Denver Public Schools and Stanford University *s 
Institute for Communication Research are currently engaged 
in a joint research project on the context of instructional 
television. The purpose of the project is to learn how 
instructional television can best fit into the total teach*- 
ing situation. A substantial amount of research has estab- 
lished that television is a very effective teacMng medium. 
Ways of combining it with other educational activities must 
now be considered, and the Denver-Stanford project is a 
beginning effort in this direction. Kenneth E. Oberholtzer 
is principal investigator for the Denver Public Schools 
and Wilbur Schramm is principal investigator for Stanford 
University. This is one of a number of project progress 
reports. 



I. BACKGROUND 

The Denver-Stanford Project on the Context of Instructional Television 
has been concerned with teaching Spanish to fifth and sixth grade pupils in 
the Denver Public Schools, and has used television as the basic instructional 
medium. !Bie project Viag involved a search for school and home activities 
which, as additions to the television instruction, would increase the amount 
of Spanish learned by pupils. 

Research in the project was conducted over three full school years, be- 
ginning with 1960-61. This report deals with results obtained during the last 
of those years, the I962-63 school year. Other findings, plus an extensive 
discussion of the project’s background, have been treated in previous reports 
(1, 2, 3, 4), and these items will be repeated here only as they apply to the 

research in I962-63. 

A knowledge of the general hypotheses to ^.e tested in the project is 
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necessary to understand the third year design. These hypotheses, as originally 
stated, were: 

1. Instructional television of a certain kind, reinforced by certain 
classroom activities, makes for more learning, ceteris paribus, 
than without this reinforcement. 

2. Instructional television of a certain kind, reinforced by certain 
home activities, makes for more learning, ceteris paribus, than 
without this reinforcement. 

3 . Instructional television of a certain kind, reinforced by certain 
home and classroom activities, makes for more learning, ceteris 
paribus, than without these reinforcements or with either one alone. 

4. Certain kinds of instructional television, combined with certain 
kinds of home and classroom reinforcements, make for more learning, 
ceteris paribus, than other kinds and combinations. 

Previous reports have shown hypotheses one, two, and three to be completely 
verified. The research in 1962-63, therefore, was concerned with hypothesis 
four ~ with the systematic variation of different combinations of home and 
classroom activities to discover that combination which, when used in conjunc- 
tion with instructional television, would best meet the objectives of an ele- 
mentary school foreign language program. 

Most of the individual activities investigated in 1962-63 had been tried 
as single practices before, and in this sense the research was repetitive* The 
combinations of activities were original in large part, however, and a few 
practices were entirely new. Thus the research design in 1962-63 was both 
repetitive and original; it represented a building on previous experience and 
findings, while, at the same time, it allowed the investigation of new ideas. 

The research design and analysis of results were a?i.so based, in part, on 
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previous experience. In the project generally, outside influences on a child’s 
perfonnance (that is, independent of the child’s own ability, his previous 
learning, etc.) have fallen into three distinct and mutually exclusive 
(though interacting) sets of variables; and some attempt has been made to take 
each of these sets into account. The sets may be termed (1) method variables, 

(2) teacher variables, and (3) home variables, and are defined as follows; 

1. M ethod variables consist of those practices and activities devised 
to directly affect learning and produce a specific result. Included 
are the television presentation; the face-to-face instruction by the 
classroom teacher; the use of tape recorders, record players, and 
automated materials; certain specifically designated homework; and 
the like. These are the variables most easily manipulable and, 
therefore, most easily evaluated through experimental design, 

2. Teacher variables consist of personal characteristics of the class- 
room teacher, and they affect, among other things, the efficacy of 
many method variables. Teaching variables include the teach«“?’s 
interest in the subject matter and in new '‘teaching techniques, the 
number of courses in foreign language, his professional experience, 
his ability to achieve rapport with his pupils, etc. Many of these 
variables are extremely difficult to evaluate, though some of them have 
been approached through survey techniques. 

3 . Home variables , of great importance because they determine in large 
part the child’s interests and attitudes, are directly related to 
parental characteristics. Included are the extent of the parents’ 
education, their interest in the specific subject matter at hand, 
their willingness to work with the child, the standards of performance 
they establish, etc. Some of these variables have also been approached 
through survey techniques. 
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II. ACTIVITIES AND RESULTS AT FIFTH GRADE 
A. Research Design 

Eacperimental Procedures * Fifth grade is the first year in which pupils 
have foreign language instruction in Denver. In accord with FLES (Foreign 
Language in the Elementairy School) recommendations, the first year’s instruc- 
tion is entirely audio-lingual* That is, the first year’s instruction is 
devoted entirely to the development of understanding and speaking skills* 
Development of the other language skills, reading and writing, begins at sixth 
grade. 

The basic element of the audio-lingual instruction at fifth grade was a 
l^Hiiinute television program, seen every Monday, Wednesday, and Friday from 
12:45 to 1:CX) p.m. by each pupil. The television experience was therefore 
the same for everyone* In fact, this television experience was standa r d 
throughout the three years of research; the lessons were developed and recorded 
on videotape prior to use in I 96 O- 6 I and were repeated each year thereafter (5). 

A second common element was a 15**minute follow-up to the television 
lesson* This follow-up was conducted by the classroom teacher throu^ an 
eclectic approach which utilized structure drill, pattern drill, and a 
variety of other activities* 

The research groups at fifth grade, therefore, differed according to those 
activities which were added to in-school television viewing and teacher-directed 
eclectic practice. These additional activities were directed toward evaluating 
and learning more effective uses of certain electronic aids in the classroom. 
More specifically, the aids consisx;ed of record players and tape recorders 
which allowed a child to hear Spanish spoken by a native speaker and, in some 




cases 1 record his own voice and hear it played back. 

Three groups were set up according to this scheme: 

1 . No electronic aids . Children in this group had only the common 
elements of TV viewing and eclectic practice. They served primarily 
as a control group, or in other words as a base against which to 
compare the performance of other pupils. 

2. E3.ectronic aids without feedback . Children in this group had, in 
addition to TV viewing and eclectic practice, record players or in 
a few cases tape recorders. This group did not record their own 
voices. Rather, they listened to specially-prepared lesson segments. 

3. Electronic aids with feedback . Children in this group had, in addi- 
tion to the common activties, tape recorders which were used to 
record and play back their own voices. They also made use of 
special lesson segments. 

Electronic aids without feedback, with record players only, were tried 
in 1961 - 62 ; therefore, the first two groups in the 1962-63 design constituted 
an eacact replication. This part of the design was replicated because the 
earlier results failed to provide clear-cut conclusions. Overall, there %ias 
no significant difference in overall performance between those %dio had record 
players and those who did not, though some specific classes seemed to profit 
by them (2). Further investigation led to the suggestion that teachers 

had not been sufficiently informed as to how the aids should be used. There- 
fore, in 1962-63 a set of suggested uses of the aids with each lesson was pre- 
pared by language experts and distributed to the appropriate teachers. In 
addition, these teachers attended special training sessions devoted to the 
electronic aids. 

The feedback condition of the third research group had not been tried 



previously and was thus original in 1962-63. The idea behind feedback is that 
a pupil can better understand and correct his mistakes in pronunciation vdien 
he hears himself speak, especially if he can compare his own performance to 
that of an expert. Thus, in addition to the opportunity for varied, directed 
practice in listening and speaking provided under the no-feedback condition. 



the pupil has further help in pronunciation. 

All practice with electronic aids occurred in the classroom. The most 
immediate reason for this was that no elementary schools in the Denver system 
had language laboratories. In any case, however, it would seem desirable to 
keep the electronic aids in the classroom the first year of instruction because 
of the closer control allowed the classroom teacher. Fernand Marty has commented 



as follows on the need for close teacher supervision in the beginning year: 

...the most favorable situation for improvements in pronunciation is 
idien the teacher, the student, and the machine work jointly. The 
teacher guides the student, he tells him whether he is f 
to correct pronunciation .... (Without the active help of the teacher) 
the student is generally unable to determine by himself the causes 
(of his incorrect pronunciation) (6). 

In addition to the above three experimental conditions, the research design 
provided for parent participation. For the third year, parents were given the 



opportunity to volunteer to help their children in Spanish. 

As before, parent participants were asked to view a repeat of the TV 
lesson in the evening with their children, to use a special guide book which 



suggested various home activities, and to use phonograph records which were 
provided to improve listening and speaking skills. (For a more complete dis- 
cussion of the home activities, see references 4 and 7.) 

Thus each child was classified in the design in two ways — according to 
his primary research group and according to whether or not his parents par- 
ticipated. The six possibilities under this design are shown on the following 
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No electronic 


Electronic aids 


Electronic aids 


aids 


without feedback 


with feedback 


No parent help 


No parent help 


No parent help 


No electronic 


Electronic aids 


Electronic aids 


aids 


without feedback 


with feedback 


Parent help 


Parent help 


Parent help 



Research Conditions for Fifth Graders 

In 1962-63 

Figure 1 



Assignment to Procedures « Throughout the project, assignment to primary 
research group has been by class rather than by individual pupil. Administra- 
tive conditions in the separate schools render assignment by individuals 
practically impossible in a study of this size. Ihe number of classes assigned 
to each group in I962-63 was determined by the amount of electronic equipment 
on hand. Otherwise, assignment was on a random basis. Thus, the number of 
classes to be assigned tape recorders was determined; and, from a list of all 
teachers in the project, this number was drawn at random. From those remaining, 
classes to be assigned record players were determined in like manner. Those 
still remaining were assigned to the no-electronic-aids condition. Under this 
scheme, approximately one-half of the fifth grade classes had no electronic 
aids, approximately one-fourth had electronic aids without feedback, and 
approximately one-fourth had electronic aids with feedback. 

As indicated above, assignment to pairent participation groups was not 
based on probability methods. Rather, it depended entirely on whether or not 
a child's parents volunteered. The munber of such volunteers at fifth grade 
in 1962-63 was 28?^, approximately ^5 per cent of the total fifth grade popu- 
lation. This was the largest number of parent volunteers obtained during the 
project; and, in view of the fact that parent participation was in its third 
year and had thus lost much of the glitter of something new and exciting, this 
response was most heartening. Apparently, parent participation of this nature 
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can be used by a school system as an on-going project. 

Measurement and Analysis . The pertinent language skills, understanding 
and speaking ability, were measured at the end of each semester through listen- 
ing comprehension and speaking tests previously developed by project personnel 
(8, 9). Also, a listening comprehension pre-test was administered the first 
week of school. Other information gathered for each pupil in the project in- 
cluded IQ, as measured by the Kuhlman-Anderson Test; the paragraph meaning (PM) 
score from the Stanford Achievement Test; grade point average (GPA) in academic 
subjects for the two previous school years; sex; amount of Spanish spoken in the 
home prior to the beginning of the project; and occupation (according to the 

Hollingshead scale) of the head-of-the-household. 

In addition to the information on pupils, the following data were collected: 
class size, whether or not the Spanish teacher was also the regular classroom 
teacher, and the experience and formal preparation (TEP) of the Spanish teacher^ 

The primary technique used to analyze results was the analysis of co- 
variance, through which the influence of certain measureable variables can be 
controlled or held constant from group to group. Pre-test, IQ, PM, and GPA were 
used as control variables in each separate analysis. In addition, the first 
semester test was used as a control in analyzing second semester results when 
it was desired to reflect only the amount learned the second semester. The 
dependent variable in each case was one of the language skills. Certain of 
the other variables were used as secondary independent or mitigating variables, 
so that their influence on the dependent variables and their interaction with 
the primary independent variables of experimental treatment and parent parti- 
cipation were measured. 
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1. Experimental Treatment 

ListeninR Comprehension . Overall, there were no significant differences 
between the primary research groups on either of the listening comprehension 
tests. Table 1 shows results of the covariance analysis of the second semester 
final, with and without the first semester final as a control variable. When 
the first semester final is used as a control, the results reflect only the 
amount learned during second semester; otherwise, the amount learned the com- 
plete year is reflected. 



Table 1 



ONE-DIMENSIONAL COVARIANCE ANALYSES 
OF THE FIFTH GRADE SECOND SEMESTER LISTENING COMPREHENSION TEoT 
WITH AND V’flTHODT THE FIRST SEMESTER TEST USED AS A CONTROL VARIABLE 



1 

i 



I 



] 




With the First Semester Test 


Without 


the First 


Semester Test 






Source of 
Variation 




Residual 


Source of 
Variation 




Residual 






Degrees of Sum of Mean 

Freedom Squares Square 




Degrees of Sum of 
Freedom Squares 


Mean 

Square 




Total 


875 


21, 294.872 


Total 


876 


37,744.56c 




V/ithin 

Groups 


873 


21,205.866 24.291 


V/ithin 

Groups 


874 


37 , 684.535 


43.117 


Between 

Groups 


2 


89.006 44.503 


Between 

Groups 


2 


60.027 


30.013 






F 


. 44.503 . , 
■ 24.291 ~ 

P > .05 




F = 


. 30.013 _ . coc 
' 43.117 ~ 

P > .20 



Means of test scores and of other control variables used in analyses 
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are given in table 2, and semester test scores adjusted by the covariance 
technique, are in table 3. (Group variances on each test are given in 
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Appendix A). Since the covariance analyses indicated that no differences 
between experimental groups were significant, no statistical comparison of 
individual group means was made* 

Table 2 






GROUP MEANS AT FIFTH GRADE 
ON THE DEPENDENT AND CONTROL VARIABLES 
USED IN LISTENING COMPREHENSION TEST ANALYSES 



Variable 




EXPERIMENTAL GROUP 






No Electronic 
Aids . 


Electronic Aids 
Without Feedback 


Electronic Aids 
With Feedback 


Total 


Second 

Semester 

Test 


55.827 


36.279 


56.567 


36.141 


First 

Semester 

Test 


36 . 5^7 


36.914 


56.175 


36.472 


Pre-test 


8.923 


8.664 


8.601 


8.739 


PM 


5.528 


5.780 


5.596 


5.630 


GPA 


2.603 


2.711 


2.607 


2.639 


IQ 


103.043 


105.675 


105.851 


104.128 



Table J> 

ADJUSTED GROUP MEANS 

ON THE FIFTH GRADE LISTENING COMPREHENSION TESTS 
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Experimental Group 



Semester test 



No Electronic Electronic Aids Electronic Aids 
Aids Without Feedback V/ith Feedback 



Total 



First 


36.467 


36.590 


36.359 


56.^72 


Second — second semester's 
learning reflected 


35.975 


55.856 


36.620 


56.1^1 


Second — full year's 
learning reflected 


35.988 


35.927 


36.552 


56.141 


(N) 


(323) 


(280!' 


(278) 


(881) 



L 



O 

me 
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Though no differences were significant, a pattern can be seen in the 
comparison of means from one semester to the next. This pattern is more 
evident when the three sets of means in table 3 are plotted on a bar graph, 



as in figure 2. 




Bar Graph of Adjusted Means Which Reflect Amount 
Learned the First Semester, Second Semester, and Full Year 

Figure 2 

As table 3 and figure 2 show, all tlu,-ee groups demonstrated quite sxmilar 
amounts of learning the first semester; the adjusted first semester means were 
very close. During the second semester, however, the group usxng electronic 
aids with feedback achieved more than either of the other two groups, and 
this results in a higher mean score where learning for the whole year is re- 

fleeted. 



This outcome could be entirely the result of chance since no differences 
between means were statistically significant. Ihe second semester differences 
would seem to merit consideration, however, because they fit a pattern observed 
with an entirely different group of pupils during the 1961-62 school year. 
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The 1961-62 results indicated that a certain amount of experience and/or 
preparatio i is necessary on the part of the classroom teacher before the 
electronic aids can be used profitably ( 2 , pp, 7 - 3 . 2 ). The pattern observed 
in 1962-63 would seem to suggest the same thing. No improvement in listening 
comprehension skills resulted from the use of electronic aids the first semester, 
but an improvement may have occurred, at least v;here feedback was involved, the 
second semester. A logical explanation for this, in light of past results, 
would be that a semester's experience was needed before the classroom teachers 
could use the aids to advantage. 

Because of the lack of statistical significance, the observed pattern is 
at most suggestive, and further information is needed before any more conclusive 
statements are possible. Such information is, fortunately, available. The 
experience and preparation of classroom teachers was again measured during 
1962-63 so that a further test of the interaction of this teacher variable with 
the electronic aids method variable is possible. 

Results of the two-dimentional analyses, with teacher experience and 
preparation (TEP) as one dimension and experimental treatment the other, 
are given in table 4 . The first semester listening comprehension test is the 
dependent variable in one analysis, and the second semester test, with the 
first semester test as a control variable., is the dependent variable in the 
other, (As mentioned before, IQ, PM, GPA and pre-test are used as control 
variable in all such analyses.) Thus, the amount learned the first semester 
is reflected in one analysis, and the amount learned the second semester is 
reflected in the other. 

Table 4 indicates that there were no statistically significant effects 
during either the first or second semesters. On the thought that full year 
results might be different, the second semester test was reanalyzed without 

ERIC 



the first semester test as a control, but the resulting F-ratios showed very 
little change. These analyses, therefore, shed no light on the problem. 



Table 4 

TWO-DIMENSIONAL COVAEIANCE ANALYSES 
OF FIFTH GRADE LISTENING COMPREHENSION TESTS 
EXPERIMENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 

First Semester Test 



Source of 
Variation 




Residual 








Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F-ratio 


Probability 




TEP 


2 




60.391 


30.196 


.622 


>.20 


Interaction 


4 




141.123 


35.281 


.726 


>.20 


Within 

Groups 


903 




43,836.972 


48.546 






Second Semester Test 


Source of 




Residual 








Variation 


Degrees 

Freedom 


of 


Sum of 
Squares 


Mean 

Square 


F-ratio 


Probability 


TEP 


2 




99.169 


49.584 


1.969 


> .05 


Interaction 


4 




152.399 


38.099 


1.515 


1 

V 

• 

0 

vn 1 

1 


Within 

Groups 


902 




22,707.087 


25.174 







A glimmer appears, however, when the adjusted means for the full year are 
examined in table 5* There the aids-with-feedback means are 34.951 the low 
TEP group, 35.388 for the middle group, and 37*503 for the high group, and the 
differences between the middle and high groups and the low and high groups are 
statistically significant. For the first difference, the critical ratio (Dji/j/Oj^j^) 
is 2.115/1.127 = 1.877 j which has probability of approximately .06; and for the 
second, the critical ratio is 2.552/1.200 = 2.127, with corresponding pro- 
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bability less than . 05 . Thus, at least for the aids-with-feedback 
pupils, a relationship exists between the development of listening compre- 
hension skills and the experience and preparation of the classroom teacher. 
"Feedback pupils" whose teachers rauiked high on TEP had an adjusted full- 
year score of 37.503, which was more than a full point higher than that of 
any other group in the two-way matrix* This suggests that- the aids can be 

used effectively. 

Table 5 

ADJUSTED GROUP MEANS 

ON FIFTH G?JU)E LISTENING COMPREHENSION TESTS 
EXPERIMENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 





Experimental 




Teacher Experience and Preparation 




Treatment 


First Semester Test 


Second Semester Test — 
First Semester as Control 


Second Semester Test 
No First 

Semester Control 




Low Middle 


High 


Low 


Middle 


High 


Low Middle 


Hisn 


No Electronic 
Aids 


55.736 36.^?9 


35.911 


36.262 


36.490 


35.851 


35.851 36.465 


35.851 


Electronic Aids 
Without Feedback 


36.135 37.132 


35.510 


35.^81 


35.716 


35.998 


35.353 36.297 


35.425 


Electronic Aids 
With Feedback 


36.106 36.668 


37.131 


35.099 


35.136 


36.922 


34.951 35.388 


37.503 


Total 


35.978 36.651 


36.205 


35^659 


35.861 


36.365 


35.420 36.101 


36.288 





Overall, however, the I962-63 results, like those of I96I-62 related to 
electronic aids, are far from clear-cut. Many more questions remain un- 
answered t h ^ T ) answered on the relationshi.p between TEP and use of the aids* 



So far only the interaction of teacher experience and preparation with 
experimental treatment has been considered* Information on several other 
possible influencing variable was collected; these include sex of pupil, 
prior Spanish spoken in the home, class size, and regular classroom versus 
special teacher for Spanish* Results of analyses in which these were used as 



secondary independent vaiiables are shown in table 6. This table gives F-ratios 
and probabilities for the secondary categorizations and for the interactions 
between each secondary variable and experimental treatment. In addition, 
adjusted means for the secondary categories are shown. The second semester 
listening comprehension test is the dependent variable , and the first semester 
test is not used as a control so that learning for the whole year is reflected. 

The only variable causing significant differences is prior Spanish in the 
home* Both the secondary categorization differences and the interaction are 
significant beyond the .001 level. This interaction merits further consider- 
ation and, to allow this, adjusted means for the interior cells of the two- 
dimensional matrix are shown in table 7* 



Table 6 

TESTS OF DIFFERENCES AND INTERACTIONS 
FOUND IN TWO-DIMENSIONAL ANALYSES 
SHOWING FULL YEAR’S LEARNING 



Secondary 

Variable 


Category 


Test 

Mean 


F-Ratio 


Probability 


Sex 


Male 


36.824 


< 1.000 


> .20 




Female 


35.272 


Interaction 






2.006 


> .05 


Prior 
Spanish 
in home 


Most of the time 


39.433 






Part of the time 


36-576 


6.084 


< .001 


Very little of the time 


35.633 


None of the time 


“ 35 TBBO 






Interaction 






4.958 


< .001 


Class Size 


33 or fewer pupils 


36.003 


< 1.000 


> .20 


34 or more pupils 


36T!t39 


Interaction 






2.048 


> .05 


Regular or 
Other Teacher 


Has pupils all day 


35.653 


2.145 




Has pupils part of day 


36.433 


0 

• 

A 


Teaches Spanish only 


36.244 







Interaction 



1.920 



> .05 
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Table 7 

ADJUSTED MEANS 
ON THE SECOND SEMESTER 
LISTENING COMPREHENSION TEST 
PRIOR SPANISH BY EXPERIMENTAL GROUP 



Spanish Spoken 
in Home Prior to 
Beginning Prog?'am 




Experimental Group 




No Elec :ronic 
Aids 


Electronic Aids 
Without Feedback 


Electronic Aids 
With Feedback 


Most of the tiroe 


41.678 


37.655 


37.026 


Part of the time 


36.604 


35.777 


37.808 


Very little 
of the time 


34.355 


37.557 


35.051 


None of the time 


35.693 


34.751 


57.171 



The interaction (or inconsistency from group to group) seems to be more 
logically explained when the means in table 7 are e x a mi ned by row rather than 
fey column. Children frcMU homes where Spanish is spoken most of the time 
definitely do better without electronic aids. For the others, however, some 
form of the electronic aids produces the most learning, though the pattern is 
not clear by cJiy means. V#here Spanish is spoken part or none of the time, 
those with fecjdback did best; whereas, the very-little-of-the-time group did 
better without feedback. The latter group did better with feedback than with 
no electronic aids at all, however. 

Just why the electronic adds are relatively so much less effective among 
children from homes where Spanish is spoken is uncertain. It has been sug- 
gested that these children are confused by differences between the Spanish 
taught in the school program auid that spoken in their homes, auid that the 
electronic aids heighten this confusion. Whatever the cause, however, 
children from Spauiish speaJcing families comprise only about 7.5 per cent of 
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the school population in Denver and would be a considerably smaller group in 
most other cities in the United States. Even in Denver, therefore, more than 
nine out of every ten children could profit from the use of electronic aids -in 
some form, and the feedback condition seems the more desirable. 

Speaking . Development of speaking skills under the three e^erimentad 
conditions at fifth grade was also evaluated through covauriance anailysis. The 
relative amounts learned each semester and during the ccxnplete year were de- 
termined through use of speaking tests administered at the end of each semester, 
and through the selection of control variables. None of the one-dimensional 
anadyses, con^sTing the performances of the three baisic e^erimentad groups, 
produced statistically significant results. The analysis reflecting learning 
for the whole yeaur is shown in table 8; adjusted second sonester means, with 
and ifithout the first semester test used ais a control variable, plus group 
numbers are given in table 9* The numbers here aure much smadler than those 
used in the listening conqsrehension amadyses because of the nature of the 
speaking tests. To achieve the test reliability needed for valid group com- 
parisons, it was necessairy that these tests be administered individuadly to 
pupils by project personnel. This process limited the number of pupils who 
could be tested. 

The same pattern concerning relative amounts leaimed each semester is 
observed here as for the listening comprehension results, only in this case 
the reversal is complete. During the first semester, children with no aids 
performed best and those having aids with feedback were poorest. During the 
second semester, however, the adds-with-feedback condition produced the most 
learning, while the no-aids condition produced the leaist. These two trends 
balance themselves so that, for the complete yea^r, the means are quite 




similar. 
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Table 8 

ONE-DIMJWSIONAL COVARIANCE ANALYSIS 
OF THE FIFTH GRADE SECOND SEMESTER SPEAKING TEST 



Source of 
Variation 




Residual 




Degrees 

Freedom 


of 


Sum of 
Squares 


Mean 

Square 


Total 


171 




1,446.927 




VJithin 

Groups 


169 




1 , 436.774 


8.502 


Between 

Groups 


2 




10.153 


5.077 




F = 


5.077 

8 T 502 


= 0.597 








P> .20 







Table 9 



ADJUSTED GROUP MEANS 
ON THE FIFTH GRADE SPEAKING TESTS 




Experimental Group 



Semester 



First 



No Electronic Electronic Aids 
Aids Without Feedback 



Second — Second S«nester's 
Learning Reflected 



7.826 

16.167 



7.603 

16.559 



Electronic Aids Total 
With Feedback 



7.187 



7.577 



16.967 16.511 



Second — Full year*s 

Learning Reflected 16.357 

(N) (71) 



16.629 

(55) 



16.609 16.511 

(49) (175) 




The speaking results, therefore, offer the same suggestion as was noted for 
listening comprehension— that the electronic aids require a semester's experience 

before they are generally used profitably. 

The same secondary independent variables were used for the two-dimensional 
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covariance analyses of speaking skills as of listening comprehension skills. 
Therefore, the results on teacher experience and preparation again allow a 
further test of the conjectured relationship between TEP and use of the 
electronic aids. The interaction between TEP and experimental treatment was 
not statistically significant, though the marginal categorizations by TEP 
produced an F-ratio of 7.08? where second semester results were considered. 

With n^of 2 and n^ of 121, this F-ratio is significant beyond the .01 level. 
Adjusted means of the second semester speaking test, with the first semester 
test used as a control, are shown in table 10. Unfortunately, too few pupils 
with teachers low in TEP were tested to allow inclusion of the low TEP category 
■in the two-dimensional analysis. This occurred because the samples for testing 
were drawn before the TEP questionnaires were evaliiated, making stratification 
on TEP impossible. 



Table 10 

ADJUSTED FIFTH GRADE MEANS 
ON THE SECOND SEMESTER SPEAKING TEST 
RESEARCH GROUP BY TEACHER EXPERIIMCE AND PREPARATION 



Teacher Experience 




Experimental Group 




and Preparation 


No E3.ectronic 
Aids 


Electronic Aids 
Without Feedback 


Electronic Aids 
With Feedback 


Total 


High 


17.678 


l 6 . 6 oif 


17.283 


17.213 


Middle 


15.372 


15.875 


16.551 


15.791 



The results in table 10 do not follow the same pattern in the interior ceils 
of the matrix that was found for listening comprehension. The pattern here, rather, 
resembles that of 1961-62 in which pupils of teachers in the middle TEP position 
performed relatively better with electronic aids, while those of teachers in the 
high position did best with no aids. 
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None of the other interactions was statistically significant, nor did any 
other secondary categorizations produce significant differences. Nevertheless, 
because prior Spanish produced significant results on the listening comprehension 
test, this variable was examined in further detail. The adjusted second semester 
means, reflecting the full year’s learning, are shown in table 11. The limited 
numbers forced a combination of the "most" and "part of the time" categories. 

A comparison of table 11 with table 7 reveals that the pattern of means is 
precisely the same for speaking as for listening comprehension. That is, pupils 
from homes where Spanish is spoken do better with no electronic aids, while the 
others do better with some form of the aids. Furthermore, as on listening compre- 
hension, the feedback condition produces the most favorable results where Spanish 
was not previously spoken in the home. 



Table 11 



adjusted means 

ON THE SECOND SEMESTER 
FIFTH GRADE SPEAKING TEST 
PRIOR SPANISH BY EXPERIMENTAL GROUP 




Spanish Spoken Experimental Group 

in Home Prior to Electronic Electronic Aids Electronic Aids 

Beginning Program Without Feedback With Feedback 




Most or Part of 19.673 l?.l45 16.328 

the time 



Very little of 
the time 


15.522 


16.605 


15.729 


None of the time 


16.241 


16.547 


17.345 



Overall, the speaking results generally support those of listening 
comprehension. They support fairly well the notion that the electronic aids 
ai*e used to better effect as the classroom teacher gains experience 
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with them, and they offer solid backing to the finding that electronic aids are 
most valuable if the pupil is not from a home where Spanish has been spoken 
previously. 

2. Parent Participation 

For the third consecutive year, parent participation proved of significant 
value to most pupils. The results in I962-63 were, in fact, quite similau: in 
every respect to those of the previous year. Parent participation had greater 
effect the first semester thein it did the second, and a significant interaction 
between parent participation and prior Spanish in the home was found. The 
results were similar on both listening comprehension and speaking. 

Table 12 

TWO-DIMENSIONAL COVAKIANCE ANALYSES 
OF FIFTH GRADE LISTENING COMPREHENSION TESTS 
PARENT PARTICIPATION BY PRIOR SPANISH SPOKEN IN HOME 



First Semester Test 






Residual 








Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Meeui 

Square 


F-ratio 


Probability 


Parent 

Participation 


1 


98.982 


98.982 


2.635 


> .05 


Prior Spanish 
in Home 


3 


3,253.617 


751.206 


20.000 


< .001 


Interaction 


3 


264.564 


88.188 


2.347 


> .05 


Within 

Groups 


808 


30.3it9.201 


37.561 
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Table 12 (cont'd) 

T'.VO DIMENSIONAL COVARIANCE ANALYSES 
OF FIFTH GRADE LISTENING COMPREHENSION TESTS 
PARENT PARTICIPATION BY PRIOR SPANISH SPOKEN IN HOME 



Second Semester Test 


Source of 




Residual 








Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F-ratio 


Probability 


Parent 

Pau*ticiaption 


1 


77.067 


77.067 


1.902 


> .05 


Prior Spanish 
in Home 


3 


1,9^.100 


646.700 


15.064 


< .001 


Interaction 


3 


336.3^9 


112.116 


2.768 


< .05 


Within 

Groups 


808 


33,736.301 


40.510 







Results of two two-dimensional covariance analyses, with parent participation 
and prior Spanish in the home as the separate independent variables, are shown 
in table 12, In one analysis, the first semester listening comprehension test is 
the dependent variable. In the other, the second semester test is the dependent 
variable, and is not controlled for first semester results, bhen only second 
semester learning is reflected (analysis not shown) , none of the effects produce 
significant results. 

Adjusted means for these two-dimensional breadcdowns are given in table 13* 

In addition, this table includes the means which reflect only second semester learning. 

This table shows that parent participation is most effective where the least 
amount of Spanish was spoken in. the home prior to enrollment in the program. This 
has been the finding in previous years as well. Where no Spanish was spoken, the 
situation of a majority of the children, parent help increases learning to a highly 
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significant degree, and it increases learning, though to a smaller degree, for 
those in the very-little-of- the- time category. On the other hand, where Spanish 
is spoken in the home most of the time, parent help is definitely detrimental® 

The occurrence of this effect at statistically significant levels over a three 
year span, with entirely different groups of pupils and parents, leaves no doubt 
that the effect is real. For most children, parent help in Spanish can be dis- 
tinctly advantageous. 

Table 13 

ADJUSTED FIRST AND SECOND SEMESTER MEANS 
IDR FIFTH GRADE LISTENING COMPREHENSION TESTS 
PARENT PARTICIPATION BY PRIOR SPANISH SPOKEN IN HOME 



Spanish Spoken 
in Home Prior to 
Beginning Program 






Test 








First 


Semester 


Second Semester — 
Semester Reflected 


Second Semester — 
Full Yeeu* Reflected 




Parent 

Help 


No Parent 
Help 


Parent 

Help 


No Parent 
Help 


Parent 

Help 


No Parent 
Help 


Most of the time 


42.462 


41.893 


36.486 


38.099 


40.571 


41.811 


Part of the time 


36.474 


38.667 


36.705 


36.385 


36.865 


37.981 


Very little 
of the time 


36.798 


36.365 


35.857 


36.015 


36.229 


36.105 


None of the time 


36.004 


34.446 


36.074 


35.351 


35.926 


34.081 



The more disturbing and less understandable aspect of this pattern 5.s the 
detrimental effect of parent help on those children from homes where Spanish is 
spoken natively. One explanation previously advanced is that there is a confusion 
between the ’’school Spanish” taugjit in the program and the local version of Spardsh 
used at home. Thus, the parent might attempt to help the child, but his own Spanish 
is so different that he actually hinders. Another explanation, also previously 
advanced, is that a higher proportion of parent volunteers from the Spanish 
speaking group than from other groups may have failed to follow through v;ith the 
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activities. The result in this case could have been a negative attitude toward 
Spanish on the part of the child. 

Fortunately, a partial test of the contending explanations was possible through 
use of the socio-economic status (SES) information available. As previously stated, 
the occupation of the head-of-household v/as determined for each child. Occupation 
is not a perfect indicator of SES, of course, but it is one of the most valid 
single indicators which can be readily applied to large groups. 

It happens that a large proportion of Spanish speaking adults in the Denver 
area fall into the lower SES categories. A failure by Spanish speakers to continue 
the parent-participant activities would be expected to relate to this fact of 
social class, and such a failure would therefore be typical of other low SES 
groups. In this event, an interaction would exist between occupation and parent 

p£U['ticipation • 



Table l 4 

TWO-DIMENSIONAL COVARIANCE ANALYSIS 
OF THE SECOND SEMESTER LISTENING COMPREHENSION TEST 
PARENT PARTICIPATION BY OCCUPATION OF HEAD-OF-HOUSEHOLD 



Source of 
VeU:*iation 




Residual 




F-ratio 


Probability 




Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


Parent 

Participation 


1 


198.313 


198.313 


4.937 


< .05 


Occupation 


2 


11.317 


5.659 


0.141 


> .20 


Interaction 


2 


12.258 


6.129 


0.153 


> .20 



Within 

Groups 583 23 , 420.228 40.172 
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To test this idea, children in the "part” and "most of the time" categories 
on prior Spanish were eliminated so that the occupation categories would be 
free of Spanish speakers, and parent participation was run against occupation 
in a two-dimensional analysis. The results with full year learning reflected 
are given in table l4. 

When the children from homes where Spanish is spoken natively are elimi- 
nated, the overall difference between those with and those without parent help 
becomes statistically significant. Neither the interaction nor the differences 
produced by the categorization by occupation are significant. Adjusted means 
relating to table l4 are given in table 15* Thes3 means are quite consistent; 
children with parent help do better than those without such help in every 
occupation category, and, further, occupation shows no relationship to per- 
formance. Evidently, a similar proportion of parent-participants at all SES 
levels followed through with the activities 

Table 15 

ADJUSTED SECOND SEMESTER 
LISTENING COMPREHENSION TEST MEANS 
PARENT PARTICIPATION BY OCCUPATION OF HEAD-OF -HOUSEHOLD 



Occupational 

Level 


Parent 


Participation 




Parent 

Help 


No Parent 
Help 


Total 


High 


36.364 


34.452 


35.394 


Middle 


55.871 


35.053 


35.441 


Low 


35.906 


34.799 


35.235 


Total 


35.996 


34.863 


35.384 
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The problem, therefore, would appear to lie with Spanish spoken natively in 
the home and not with a failure by Spanish speaking parents to continue with the 
activities. This finding enhances the value of the parent help method, for it 
shows that it will work at all levels of social class. 

On the speaking results for the full year, the parent help pupils performed 
significantly better than those without parent help. The F-ratio on the one- 
dimensional analysis was 4.26? which, with nj^ of 1 and 112 of 145, is significant 
beyond the .05 level. The adjusted means were 17.043 for the parent help group 
and 15.780 for the others. Thus, parent help made a statistically significant 
contribution to the speaking skill. The lack of numbers on the speaking test 
made testing the effects of prior Spanish through a two-way breakdown impossible. 

C. Summary 

In summary, fifth grade results show that the electronic aids, especially 
those with feedback, are a desirable addition to the classroom Spanish program. 

An exception to this occurs among children from homes vhere Spanish is spoken 
natively. This exception affects very few children, however; the vast majority 
can profit from the use of electronic aids. 

Parent participation, for the third consecutive year , also proved to be 
valuable. Again the exception is among children of native speakers. 

It was found previously that the eclectic method is best for direct teachings 
and results over the total span of the project leave no doubt that well-prepared 
and experienced teachers improve the quality of instruction. A carefully prepared, 
on-going inservice training program would therefore seem to be a must for any 
school system combining television, electronic aids, and other new techniques as 
they have been combined in the Denver— Stanford project. 

The following activities at fifth grade are therefore recommended; basic 
instruction by television, teacher-directed instruction by the eclectic method, 
electronic aids with feedback, parent help at home, and an on-going teacher in- 



service training program. 
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III. ACTIVITIES AND RESULTS AT SIXTH GRADE 
A. Research Design 

Experimental Procedures . Reading and writing are introduced at sixth grade 
In the Denver Public Schools elementary Spanish program, and a major portion of pro- 
ject effort at sixth grade in 1962-63 went into the evaluation of ways to intro- 
duce the reading and writing skills. At the same time, the teaching of listening 
comprehension and speaking skills was continued. 

The most interesting innovation introduced in the project with regard to 
reading and writing hcis undoubtedly been automated instruction. Automated programs, 
designed to teach children to read and write the Spanish they have already learned 
to understand and speak, were developed during the first two years of research (10). 

In 1961-62, reading and writing instruction entirely by the automated approach 
and entirely by the teacher-directed approach were compared. Results of this 
comparison led to the conclusion that automated instruction is indeed an effective 
and useful teaching device, but that it does not seem capable of carrying the 
entire teaching load, at least at the elementary school level. In the report on 
I96I-62 results, it was hypothesized that automated instruction would be most 
effective when combined in some way with teacher-directed instruction. 

This hypothesis was tested in I962-63 through various combinations of auto- 
mated and teacher-directed instruction. In setting up research groups, a base 
for comparison was first established by repeating the automated only and teacher- 
directed only conditions from the previous year. The automated-only groups were 
in turn divided so that original (0) and revised (R) versions of the materials 
could be used. (The two versions are described in a previous report. See note 3). 
The original version was used in combinations with teacher-directed instruction. 

All direct in-school reading and writing instruction occurred during a 30- 
minute period from 12:43 to 1;13 each Wednesday. In addition, each sixth grade 
pupil was given audio-lingual instruction on Tuesdays and Thursdays. The audio- 
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1-ingiipi instruction was handled in much the same way as .^:or fifth grade; that 
is, the children first watched a 15-minute television program and then had 15 
minutes of teacher-directed instruction by the eclectic method. This instructxon 
was the same for all sixth graders and was therefore constant in the experimental 

design. 

The design incorporated two additional activities which were introduced 
in 1962-63. One was a special area of the c3.assroom, termed the “Spanish cor- 
ner”, in which Spanish books and newspaper, record players with Spanish recordings, 
tape recorders, and assorted cultural artifacts were placed. Bach child in 
classes where the comer was used was allowed approximately 30 minutes a week, 
on a scheduled baisis, in the corner. The child was not directly supervised 
while in the Spanish comer, but was allowed to pursue any activity he liked. 

The second new activity was regularly assigned hcnnework. Seme of the 
children were assigned specific sections of the automated instruction book- 
lets to be completed at home, while others were assigned additional eading in 
elementary-level Spanish readers. (These readers were also used in the class- 
room in some instances, and use of them was termed “extended reading.' ) 

Die research groups, which were derived by combining the different activities 
in various ways, are shown in table I6. Note that the first four groups consist 
of activities involving no direct face— to- face instruction by the classroom 
teacher, while in the last six, the classroom teacher handles at least part 
of the instmetion directly. The activities listed in table I6 are in addition 
to the standard audio-lingual instmetion, of course. The table also shows 
abbreviated designationswhich, to conserve space, will oe used in the remainder 
of this report to indentify the different eiqperimental groups. (Unless other- 
wise indicated, the original version of the automated materials Ws^s used.) 
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Table l6 

ACTIVITIES OF RESEARCH GROUPS 
AT SIXTH GlADE DURING THE 1962-63 SCHOOL YEAR 



Group Activities 


Designation 


Automated instruction in school 


As 


Automated instruction in school, revised 
version of automated materials 


As(R) 


Extended reading in school and automated 
instruction at home 


EsAh 


Extended reading in school and automated 
instruction at home, revised version of 
automated materials 


£sAh(R) 


Teacher-directed instruction 


Td 


Teacher-directed and automated instruction 
in school 


TdAs 


Teacher-directed instruction in school and 
automated instruction at home 


TdAh 


Teacher-directed and automated instruction 
in school and extended reading at hcmie 


TdAsEh 


Teacher-directed and automated instruction 
in school and Spanish comer 


TdAsC 


Teacher-directed instruction in school, 
automated instruction at home, and 
Spanish comer 


TdAhC 



In still another innovation at sixth grade, seven teachers were set apart from 
the research design and given complete freedom to handle the classroom instruction 
in any way they liked* (Their pupils viewed the TV lessons.) The only restrictions 
were that each teacher in this group was required to keep a complete, %*ritten record 
of his activities relative to Spanish instruction, and each was asked to attend 
special meetings at which the different activities were discussed. These teachers 
were designated the "tomorrow* s classroom" group* 



Finally, parent participation was encouraged at sixth grade as well as at 
fifth grade. This wsts the second year in which parent-help was tried at sixth 
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g«de, and its use «as essentially a replication of the 1961-62 trial which showed 
that r^ent help continues to he beneficial to pupils in their second year of 
Spanish instruction. As at fifth grade, pupils with parent help were scattered 
throughout the research design so that each research group consisted of pupils 

%dth and without parent help. 

A 33 ie 52 it to Procedures . Random assignment was employed at sixth grade 
so far as possible, though conditions necessitated some departure from it. In 
the first place, some classroom teachers handled both fifth and sixth grade 
instruction. Since these teachers were occupied with fifth grade 
andio-lingual instruction during the 12:45 to 1:15 period each Wednesday, they 
were not available for reading and writing instruction. Teachers in this 
situation were assigned to the two automated-only conditions. As and As(R), 

«bich required no direct teaching on Wednesdays. These teachers, therefore, pro- 
vided the audio-lingual instruction for their sixth grade pupils on Tuesdays 

^ fhpv were replaced on Wednesdays by other teachers who 

and Thursdays, and they were rep^a^.c'* 

acted mainly as proctors. 

The remaining teachers, except for the seven in the «tomorrow*s classroom’* 
group, were randomly assigned to the eight other research groups. The seven with 
uarestricted classroom practice were selected in two stages. First, the 
proposed treatment was explained to all of the sixth grade teachers, and 
volunteers were requested. Some 50 teachers responded. ■B>en the seven were 
Chosen randomly from those who volunteered. This self-selection procedure 
was followed deliberately to assure interested teachers in the ..tomorrows class- 

room" group. 

AS in all previous cases, parent participation was on a volunteer tasis. 

The only restriction at sixth grade was that parents must also have par 
ticipated the previous year when their child was in fifth grade. Of some 
3,000 parents who participated in 1961-62, 1770 elected to continue their 
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participation in I962-63. A substantial (thou^ undetermined) number of the 
remainder did not continue because of lonavoidable circumstances, such as 
moving from the city. 

Measurement and Analysis . The two dependent variables at fifth grade, 
listening comprehension and speaking, served the same role at sixth and were 
measured throu^ special instruments which covered sixth grade content. In 
addition, reading and writing was of concern at sixth grade and served as a 
t hir d dej)endent variable. This skill was meeisured at the end of each semester 
throu^ 66-item reading and writing tests. 

The control and secondary independent variable were about the same at 
sixth grade as for fifth. IQ, PM, GPA, and listening comprehension pre- 
test were used as standard control variables, and sex, occupation of the head- 
of-household, class size, and teacher experience and preparation (TEP) were used 
as secondary independent variables. 

An addition was teacher and pupil attitude toward Sx)anish as an academic 
subject. Attitude was measured through a set of scales devised especially 
for the project by Paul I. Jacobs and Milton H. Maier of the Educational 
Testing Service. Three separate seal os measured pupil pre-attitude during the 
first week of the school year, teacher attitude about two- thirds of the way 
throu^ the first semester, and pupil post-attitude at the end of the first 
semester. The reported reliabilities for these scales were approximately 
.50 for pupil pre-attitude, .85 for teacher attitude, and .86 for pupil post- 
attitude. A complete description of these scales and their development is 
available from the Educational Testing Service (11). 

Attitude results were used almost entirely ais secondary independent 
variables, though, as will be seen in the results section, pupil post- 
attitude was used as a dependent variable in one or two cases. 



As stated previously, the differences between research groups at 
sixth grade depended almost entirely on the type of reading and writing 
instruction involved, and the reading and writing skill would therefore 
se«n to be the most important dependent (or criterion) variable. This is 
not true, however, because the leuiguage skills interact. The instructional 
procedure which is best in terms of reading and writing is not necessarily 
the best in terms of listening comprehension or speaking, though ideally 
this would be the case. All skills were analyzed., therefore, for a complete 
evaluation of research procedures. Covariance analysis was again the primary 
statistical technique. As at fifth grade, IQ, PM, GPA, and listening 
comprehension pre— test were used as controls in gG.1 analyses which «nployed 
one of the languaige skills as dependent variable. Also, first semester 
results were used as control variables when it was desired to reflect only 
the amount learned the second semester. 

B. Results 

1. Experimental Treatment 

Tfistening Comprehension . One-dimensional analyses of the second 
semester test were made with and without the first semester test used as 
a control variable, and results of these are shown in table 17. Hi^ly 
significant F-ratios occurred in both cases. Adjusted means are shown 
in table l8, and they prove to be quite similau:*, indicating that the dif- 
ferent treatments had relatively the same effect throughout the school 



year. 



Table 17 



ONE-DIMENSIONAL OOVAHIANCE ANALYSES 
OF THE SIXTH GRADE SECOND SEMESTER LISTENING COMPREHENSION TEST 
WITH AND blTHODT THE FIRST SEMESTER TEST USED AS A CONTROL VARIABLE 



With the First Semester Test 


Without the First Semester 


Test 




Source of 
Variation 


Residual 




Source of 
Variation 


Residual 




Degrees of Sum of 

Freedom Squares 


Mean 

Square 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 




Total 


1,848 51,990.781 




Total 


1,8^9 


69,524.729 




Within 

Groups 


1,839 51,175.995 


27.828 


Within 

Gh'oups 


1,840 


68,079.610 


37.000 


Between 

Groups 


9 814.786 


90.532 


Between 

Groups 


9 


1,245.119 


158.347 






- 90.532 _ , 






„ 138.347 
' ” 37.000 


= 3.739 






P < .001 






P < .001 







Table l8 

ADJUSTED SIXTH GRADE MEANS 
ON THE SECOND SEMESTER LISTENING COMPREHENSION TEST 



£3q>erimental Test Mean 

Group Second Semester's Full Year's (N) 

Learning Reflected Learning Reflected 



As 


31.873 


31.168 


(164) 


As(B) 


32.281 


32:312 


(179) 


EsAh 


33.050 


33.086 


(112) 


EsAh(R) 


31.967 


31.929 


(117) 


Td 


32.618 


32.978 


(222) 


TdAs 


32.932 


33.066 


(201) 


TdAh 


32.033 


32.309 


(230) 


TdAsQi 


31.508 


31.022 


(174) 


TdAsC 


33.769 


33.735 


(242) 


TdAhC 


32.235 


32.407 


(215) 



Table l8 shows the prediction regarding the combination of automated 
and teacher-directed instruction to be at least partially confirmed. The 
TdAs condition is clearly superior to either As or As(R), and it is 
sli^tly better than Td, though the difference is not statistically signifi- 
cant. However! by adding one more ingredient, the Spanxsh corner, to the 
combination a dramatic increase in lear nin g occurs. The best perfoinnance 
by far was achieved by those children in the TdAsC condition, that is, by 
those with automated and teacher-directed instruction in school and with a 
Spanish corner. In teims of the listening comprehension (or understanding) 
skill, therefore, TdAsC is the desirable combination. 

The two-dimensional breakdown, with experimental groups divided accord- 
ing to teacher experience and preparation (TEP), produces results vdiieh 
support quite stron^y some previous conclusions regarding the teacher variables. 
These results were si mllar each semester, so only the analysis reflect in g the 
full year’s learning is shown. Table 19 gives this analysis, and table 20 
shows the corresponding adjusted group means. 



Table 19 



TWO-DIMENSIONAL COVARIANCE ANALYSIS OF THE 
SECOND SEMESTER SIXTH GRADE LISTENING COMPREHENSION TEST 
EXPERIMENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 



Source of 
Variation 


Degrees of 
Freedom 


Residual 
Sum of 
Squares 


Mean 

Square 


F-ratio 


Probability 


TEP 


1 


^5.358 


43.358 


1.253 


> .20 


Interaction 


9 


1,775.604 


197«289 


5.449 


< .001 


Vfithin 

Groups 


1,830 


66,258.648 


36.207 
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The means for those six groups with teacher-directed instruction form 
a confusing pattern and suggest no ready conclusions. Among the four groups 
without teacher-directed instruction in reading and writing, however, the 
pattern is much more consistent and meaningful. In three of these groups, pupils 
whose teachers rated high on the TEP scale T'erformed better than those whose 
teachers rated low, and the difference between means in the one exception, AS(R) , 
was quite small. Furthermore, the differences between the low and high TEP pupils 
in the EsAh and EsAh(R) groups were by far the largest produced by the break on 
TEP. Thus the conditions with the least aunount of direct supervision in reading 
and writing, where pupils were more on their own, were the ones on which the ex- 
perience and preparation of the teacher handling the audio-lingual instruction had 
the most effect. This supports the conclusion, stated in a previous report (2), 
that the teacher exerts a motivating effect that is most noticeable when the pupil 
is free to do more or less as he likes. A more stringent test of this hypothesis 
%dll occur when reading and writing skill rather than listening comprehension is 
the dependent variable. 

Two-dimensional analyses were also run with class size and sex as the 
secondary independent variables, and the only statistically significant effect 
was an interaction, between class size and experimental treatment. No such 
analysis was possible with the reguilar-versus-special teacher variable because 
of an unfortunate distribution of numbers; only two of the ten research groups 
had at least two teachers in every cell of the matrix. A one-dimensional 
analysis showed no significant difference between pupils of special teachers 
and those of regular teachers. 

The F-ratio for the intoiaction between class size and experimental 
treatment was 3«^2, which with n^ of 9 and n 2 of 1,757, is significant beyond 
the .CK)1 level. The adjusted group meauis for the two-dimensional breakdown 



are given in table 21. 



Table 20 



56 



ADJUSTED MEANS AT SIXTH GRADE 
ON THE SECOND SEMESTER LISTENING COMPREHENSION TEST 
EXPERIMENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 



Experimenatl 

Treatment 


Teacher Experience and Preparation 


Low 


High 


As 


30.699 


31.885 


Jls(R) 


32.454 


32.157 


EsAh 


52.489 


36.201 


EsAh(R) 


30.561 


36.721 


Td 


32.931 


33.092 


TdAs 


33.565 


31.965 


TdAh 


32.016 


33.086 


TdAsEh 


31.168 


30.708 


TdAsC 


52.979 


35.268 


TdAhC 


53.451 


30.834 


Total 


32.351 


32.722 



Table 21 

ADJUSTED SECOND SEMESTER 
LISTENING COMPREHENSION TEST MEANS 
EXPERIMENTAL TREATMENT BY CLASS SIZE 



Experimental glass Size 

Treatment 

29 or fewer 30 or more 



As 


29.731 


32.602 


As(R) 


30.722 


32.282 


EsAh 


34.921 


32.441 


SsAh(R) 


31.137 


32.269 


Td 


33.667 


32.803 


TdAs 


35.941 


33.175 


TdAh 


53.413 


31.938 


TdAsEh 


30.082 


31.582 


TdAsC 


35.085 


33.205 


TdAhC 


33.040 


31.987 


Total 


32.472 


32.454 



f 



n 

The means in table 21 fit a meaningful pattern when considered by experimental 
treatment o In five of the six treatments involving teacher-directed instruction, 
pupils in smaller classes learned the most; whereas, in three of the four treat- 
ments with no teacher-directed instruction, the hi^er means were achieved by those 
in larger classes. Thus, smaller classes seem advantageous only where direct 
teacher instruction is involved. Once more, however, the analysis of reading and 

writing results will provide a more stringent test. 

To summarize, the listening comprehension results suggest that a combination 
of teacher-directed and automated reading and writing instruction in school, plus 
a Spanish corner, is desirable. Furthermore, they suggest that a direct relation 
ship exists between amount learned and the experience and preparation of the 
classroom teacher and that this relationship is strongest when the pupil is on his 
ov/n. Finally, smaller classes seem important only for direct, face-to-faoe teaching. 

Re?».dinK and Writing. One-dimensional covariance analyses of the second 
semester reading and writing test are given in table 22 and the related adjusted 
means are in table 23. Reading and writing results, like listening comprehension, 
were quite similsu* both semesters, so only second semester and full year 
learning is shown in the tables. 

The strong relationship between the reading and writing and listening com- 
prehension skills is evident in table 23, for the reading and writing results 
are quite similar to those of listening comprehension discussed previously. As 
before, teacher-directed instruction alone is better than automated instruction 
alone, but the combinition of the two produces still more learning. In this 
case, however, the difference between the Td and TdAs conditions is larger than 
it was for listening comprehension — in fact, the difference of 2.5^3 between 
the means of these groups where the full year is reflected is itself significant 
beyond the .05 level. So the hypothesis that the combination would be superior 
to either practice alone is definitely confirmed. 




Table 22 
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ONE-DIMENSIONAL COVARIANCE ANALYSES 
OF THE SIXTH GRADE SECOND SEMESTER READING AND WRITING TEST 
WITH AND WITHOUT THE FIRST SEMESTER TEST USED AS A CONTROL VARIABLE 



With the First 


Semester Test 




Without the 


First Semester 


Test 


Source of 


Residual 




Source of 




Residual 




Vgiriation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


Variation 


Degrees of Sum of 
Freedom Squares 


Mean 

Square 


Total 


1,848 


79,600.470 




Total 


1,849 


131,295.900 




Within 

Groups 


1,839 


78,230.491 


42.540 


Within 

Groups 


l,84o 


126,666.912 


68.841 


Between 

Groups 


9 


1,369.979 


152.220 


Between 

Groups 


9 


4,628.998 514.332 




,, 152.220 

^ = T 2 . 5 ^ = 

P < .001 


3.578 






F 


_ 514.332 „ 

P < .001 



Table 23 

ADJUSTED SIXTH GRADE MEANS 
ON THE SECOND SEMESTER READING AND WRITING TEST 



Experimental 

Group 


Test 


Mean 


(N) 


Second Semester’s 
Learning Reflected 


Full Year's 
Learning Reflected 


As 


15.924 


13.970 


( 164 ) 


As(R) 


16.885 


16 . 166 


(179) 


EsAh 


16.907 


16.785 


( 112 ) 


EsAh(R) 


15.569 


15.188 


(117) 


Td 


17.346 


17.474 


( 222 ) 


TdAs 


18.778 


20.017 


( 201 ) 


TdAh 


17.254 


17.711 


(230) 


TdAsEh 


17.710 


17-367 


( 174 ) 


TdAsC 


17.622 


18 r 608 


( 242 ) 


TdAhC 


18.313 


18.056 


(213) 



er|c 
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Results for both listening comprehension and reading and writing skills, 
therefore, indicate that a combination of activities is desirable* There is 
some disagreement on which combination is best, however. The listening com- 
prehension results showed the addition of a Spanish corner to the teacher-directed 
and automated in school combination to be desirable, but table 2^ shows less 
learning for this condition than for TdAs alone. This disagreement is not of 
major proportion, however, since the TdAsC means are quite close to those of 
TdAs. The larger difference — where full year learning is reflected — is 1.409 
points, which is not statistically significant. A look back at table l8 shows 
small differences betv/een these groups on listening comprehension adso, so 
either combination would seem desirable in terms of the skills so far examined* 

At least two other noteable points appear in table 23* First, automated 
instruction appears to be more useful as school work than as homework. In the two 
cases where As and Ah can be compared — TdAs versus TdAh and TdAsC versus TdAhC — 
the As means are generally higher. (Table l8 shows the As means are also 
higher on listening comprehension results.) Note, however, that in both com- 
parisons Td is a common element, so that the classroom teacher could have been 
assisting the children with their automated instruction in school. Whether a pure 
As-Ah comparison would give different results cannot be determined from the re- 
sults at hand. It would make little difference if a change did occur, however, 
because the desirability of teacher-directed instruction as a part of the com- 
bination has been firmly established. 

The second point involves the original and revised versions of the auto- 
mated materials. The I 96 I -62 results indicated rather firmly the desirability 
of the original version (3)» Table 23 does not give such a clear-cut picture, 
however. For in-school use, the revised version seems better. Furthermore, 
it is not clear that the difference in school and home environments is a con- 
tributing factor here because the home-use comparisons are contaminated by 



another variable ~ extended reading in school* It is thus not possible to 
state with any confidence which version of the automated materials seems best. 

The twO“way breakdown of reading and writing results by e3q>erimental 
treatment and by teacher e 3 q>erience and preparation confirms even more strongly 
j-ViflTi the listening comprehension results the previous conclusions regarding 
TBP* The two-dimensional covariance analysis is given in table 24 and the ad- 
justed means in table 23* 

Table 24 

TUD-DIMENSIOIiAL COVABIANCE ANALYSIS OF THE 
SECX)ND SQfESTER SIXTH GRADE READING AND WRITI WS T EST 
EXPEBmENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 



Source of Residual 



Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 

Square 


F-ratio 


Probabilltj 


TEP 


1 


1 , 038 . 7'*9 


1 , 038 . 7'»9 


15.555 


< .001 


Interaction 


9 


3 , 424.632 


380.515 


5.698 


< .001 


Within 

Groups 


1,830 


122,203.531 


66.778 
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ADJUSTED MEANS AT SIXTH GRADE 
ON THE SECOND SEMESTER READING AND WRITING TEST 
EXPERIMENTAL TREATMENT BY TEACHER EXPERIENCE AND PREPARATION 




E]q;>eriaental 

Treatment 




Teacher Experience and Preparation 






Low 




High 




As 




14.142 




13.711 




As(R) 




16.068 




16.296 




EsAh 




15.303 




24.535 




EsAh(R) 




13.419 




21.378 




Td 




17.245 




18.048 




TdAs 




20.793 




18.277 




TdAh 




17.594 




18.018 




TdAsEh 




16.623 




18.979 




TdAsC 




17.013 




21.840 




TdAhC 




17.377 




19.079 




Total 




16.848 




18.449 





Both the difference between means of the low and hi^ TEP categories and 
the interaction are hi^ily significant statistic6iHy • As the ’’total*’ figures 
indicate, there is a direct realtiondiip between TEP and test score. This 
relationship is generally demonstrated throuc^ the table, in fact, since 
the hi^ TEP group had the hipest mean score in eight of the ten research 
procedures. Overall, however, the differences tend to be relatively small, 
on the order of one to two points. 

In view of this general pattern, the differences for the two groups with 
the least amount of teacher supervision ~ EsAh and EsAh(H) — are rather 
astounding. In each group, children with hi.^ TEP teachers have means about 
60 per cent hi^er tiian those with low TEP teachers. This finding is even 
more remarkable when it is remembered that the teacher of reference here is 
the one who handles audio-lingual instruction on Tuesdays and Thursdays 
and little to do with the pupil’s reading and writing activities. That 
the characteristics of this teacher have such an inqpact on the acquistion of 
reading and writing skills — much more impact than on listening comprehension 
«iHn« with which the teacher is directly involved — suggests strong that 
the teacher plays a major role in motivating the pupil. In other words, the 
teacher inspires the child to work in those sitiiations lAere he is not under 
direct supervision. This type of influence mif^t well be felt under many 
different conditions. It could carry over into h<Miiework, for exaaqtle« The 
value of Aomevfork per se in any subject mi^t depend more on the quality of 
instruction provided in class than on any other sin^e factor . Table 25 shows 
that of the three additional groups involving luMnework •— TdAh, TdAsEh, 

and — do, in fact, support this notion. 

In any event, the importance of teacher experience and preparation is 
established, and the statement made previously, that an ongoing inservice 
program is vital in a program of this nature, has received additional support. 
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Begarding the other secondary independent variables, the situation was 
nieh the saioe for reading and »«4ting as for Ustening comprAension. tte 
analysis matching experimental treatment against class size was the only one 



Aich produced statistically significant results. The derivation of F-ratios 
for this analysis is shown in table 26, and the adjusted means ore in table 27. 
The directions of differences in table 27 follows those of tt e 3 i-ftening 



conga-ehension results (table 21) exactly. In three of the four groups with 
no teacher-directed instruction, children in larger classes scored hii^ier on 
the reading and writing test; and, in five of the six groups with teacher- 
directed instruction, performance was higher where the number in the class 
was smaUer. This outcome again suggests that having smaller classes is 
important only in the direc teaching situation where individual attention 



is required* 

to even stronger test of the class size effect would be provided by 
comparing very large classes ~ with, perhaps, ‘lO pupils or more — to very 
small classes - with 20 pupils or less. There were too few such extreme 
to allow a valid comparison, however. The distribution of classes 

by class slae is given in Appendix B. 

O^ble 26 



TWO-DIMENSIONAL OOVAHIANCE ANALYSIS OF THE 
SECOND SEMESTER SIXTH GRADE 
reading AND WRITING TEST 
GROUP CLASS SIZE 




Source of 
Variation 



Residual 

Degrees of Sum of Me^ F-ratio Probability 

Freedom Squares Square 




Within 

Groups 



1,757 



120, 612,519 



68.674 



Taole 27 



ADJUSTED SECOND SEMESTER 
READING AND WRITING TEST KJAI^S 
EXPERIMENTAL TREATMENT BI CLASS SIZE 



Experimental 


Class 


Size 


Treatment 


29 or fewer 


30 or more 





As 


13.388 


15 . 3^0 


As(R) 


15.125 


16.276 


EsAh 


22.167 


14.767 


EsAh^R) 


14 . 50 ^ 


15.948 


Td 


19.091 


16.986 


TdAs 


20.389 


19.952 


TdAh 


18.933 


17.270 


TdAsEh 


16.389 


18.112 


TdAsC 


21.690 


17.374 


TdAhC 


18.692 


17.595 


Total 


17.871 


16.967 



Thi« raises interesting team teaching possibilities. Large classes 
could be used for viewing the television lessons and for working with auto« 
mated materials, and small classes could be used for teacher-directed in- 
struction related to the eclectic audio-lingual method, the reading and 
writing activities, md the use of electronic aids. With ceureful schedul- 
ing in this kind of arrangement, each child could have more individual atten- 
tion with no increase in the number of teachers. 

Speaking . The one-dimensional analysis of the second semester speaking 
test, with full year's learning reflected, is given in table 28 . The numbers 
are small, of course, because of the nature of the test. 

The adjusted means are given in table 29 . Because of the small numbers, 
only five of the groups are represented in this table, but these form a 
meaningful pattern. 



Table 28 



ONE-DIMENSIONAL COVARIANCE AI4ALYSIS 
OF THE SIXTH GRADE SECOND SEMESTER SPEAKING TEST 



Source of 

Variation Degrees of 

Freedom 



Residual 
Sum of 
Squares 



Mean 

Square 



Total 214 5,895.861 



Within 209 5,333.580 25.520 

Groups 




Between ^ 56 O. 28 I 112.056 

Groups 




„ 112.056 

^ - 25.520 



4.391 



p< .001 



Table 29 



adjusted means on the 

SECOND SEMESTER SPEAKING TEST 



Experimental 

Treatment 


Test 

Mean 


As(R) 


21.290 


Td 


22.825 


TdAs 


20.510 


TdAsC 


20.226 


TdAhC 


24.787 


Total 


21.688 



The tv« highest means In table 29 are for those practices where the 

classroom teacher spent the full 30 minutes each Wednesday in direct, face 

understandable. Assuming that speak5.ng is 



to-face instruction. This is 



improved only through actual practice, a child who spends part of the avail- 
able time with automated instruction or with reading only is not likely to 
develop his speaking skills as highly as one who speaks Spanish the whole 
time — even thou^ the speaking takes place in what is primarily reading and 
writing instruction. Thus, if speaking is the criterion, the combination of 
automated and teacher-directed instruction in school would be less desirable 

than teacher-directed instruction alone. 

Which procedure, then, is most effective for sixth grade pupils? This 
depends on which skill is to be emphasized since the best results on each 
aif-tn were produced by different procedures. The fact is, of course, that 
all of the skills are important and should be emphasized, and a compromise 
solution is needed. 

Fortunately, a very good compromise seems available. The results on 
listening comprehension and reading and writing indicated, as previously 
noted, that either the TdAs (teacher directed and automated instruction in 
school) or TdAsC (teacher-directed and automated instruction in school and 
a Spanish comer) conditions woxild be desirable. The results in table 29 
suggest that the Spanish corner may be of some aid in developing the speak- 
ing skills, presumably because of the electronic aids in the corner. The 
TdAsC condition is not significantly different from TdAs, but TdAhC is 
significantly better than Td. Though the results are not clear-cut, the 
Spanish corner shows potential as an aid to speaking. 

The compromise, therefore would be TdAsC. With this procedure, 
conditions are close to optimum for both the listening comprehension and 
reading and writing skills, and the potential for improving speaking skills 
is present. Since this potential presumably exists because of the presence 
of electronic aids in the Spanish corner, the situation is similar to that 
at fifth grade. Teachers need special preparation in directing use of the 
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aids, and they need experience. Therefore, the effectiveness of the TdAsC 
procedure would be dependent upon an accompanying inservice training program. 

2- The ”Tomcrrow*8 ClassroGin" Treatment 
As noted previously, seven sixth grade teachers were removed from the 

experimental design and allowed to teach Spanish entirely as they wished. 

These teachers were selected randomly from a group who volunteered for this 
method, so a selection factor was operating. Self-selection was deliberately 
allowed in this instance in an attempt to get hi^ily interested teachers in 
the group. 

The results obtained by these teachers are quite exciting. mpng-i nnal 

covariance analyses comparing results of the ”tomorrow*s classroom" group with 
those of all others combined, are given in table 30, and adjusted group 
means are in table 31 • The dependent variables here are the second semester 
listening comprehension and reading and writing tests, and learning for the 
full year is reflected. 

Pupils in the "tomorrow* s classroom*' group did considerably better than 
the others on both tests, and the difference on reading and writing is little 
short of astounding. The "tomorrow's classroom" mean on reading and writing .is 
almost 50 per cent higher than the other mean. These results show what highly 
motivated and highly interested teachers can do for pupils. 

This outcome should not be taken to mean it is best to let every teacher 
do what he wishes, however, in spite of the fact that the "tomorrow's class- 
room" teachers had a free hand. Quite the contrary, these teachers used all 
of the procedures and aids available to the regular research groups, and they 
invented a number of new ones on their own. The results show, rather, the 
value of the materials and methods now at hand when used by a really interested 
teacher, and they suggest that even more varied activities are useful. 



Table 30 
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COVARIANCE ANALYSES 
OF SECOND SEMESTER TESTS 
’TOMORROV/'S CLASSROOM”CCMPAREDTO OTHER GROUPS 



Listening Comprehension Test 


Reading and Writing Test 




Source of 


Residual 


Source of 


Residual 




Variation 


Degrees of Sum of Mean 

Freedom Squares Square 


Variation 


Degrees of Sum of 
Freedom Squares 


Mean 

Square 


Total 


2,115 80,300.023 


Total 


2,115 156,920*219 




Within 

Groups 


2,ii4 79,131.008 37.432 


Within 

Groups 


150,751.932 


71.311 


Between 

Groups 


1 1,169.015 1,169.015 


Between 

Groups 


1 6,168.287 


6,168.287 




_ 1,169.015 _ -ZT -5-2Q 

P < .001 




6,168.287 
= 71.311 = 

P < .001 


86.498 



Table 31 
ADJUSTED MEANS 

ON THE SECOND SEMESTER TESTS 
•TOMORROW'S CLASSROOM ''.COMPARED TO OTHER GROUPS 



Test 


Mean 


"Tomorrow's 


Experimental 


Classroom" 


Groups Combined 


Listening Comprehension 35.932 


32.574 


Reading and Writing 25.220 


17.527 



Several of the "tomorrow's classroom" teachers came up with interesting 
activities not otherwise tried in the project, find a number of these should be 
considered in designing an elementary school Spanish program. A description of 
the '!tomorrow's classroom" teachers and the methods they employed will be provided 
in a subsequent report. 



3. Parent Pairticipation 



Parent participation proved vailuable aigain at sixth grade, and, in fact, 
the decline in its effect the second semester, noted over three years at 
fifth grade, did not occur# Covariance auiailyses of listening comprehension 
results for the two semesters are shown in table 32, and the adjusted means are 

in table 33* 

The lack of a second semester decline, though heartening, is a little 
puzzling since it has been noted consistently in other results. Perhaps it 
is i«lated to the double selection involved. Parent participation at sixth 
grade was restricted to those parents who had participated the previous year 
when their children were fifth graders, and not all of the parents elected to 
continue the second year. It would ssem safe to assume that, although some 
drop-outs occurred because of moving and other uncontrollable reasons, ma&y 
parents did not continue because of low interest in the method. Those who 
did continue would tend to have high interest. Selection was involved first 
at fifth grade and then, after a yeer-s trial, at sixth grade, and those 
parents still in the program would be those most likely to follow through with 
the assigned activities. 

Whether the double selection explanation is valid or not, these listening 
comprehension results give a very strong support to parent particiaption as 
an aid to pupil learning. 

On tests of the speaking skill, parent participation made very little 
difference. None of the F-ratios were significant; in fact, they were all 
less than 1.00. And, as would be expected from these results, the differ- 
ences between means were quite small. The ad just e'^ means, showing 1 kerning 
for each semester and the full year, are given in Table 3^. 



Table 32 



ONE-DIMENSIONAL COVARIANCE ANALYSES 
OF THE SIXTH GRADE LISTENING COMPREHENSION TESTS 
PARENT PARTICIPATION VERSUS NO PARENT PARTICIPATION 





First Semester Test 






Second Semester Test 




Source of 


Residual 




Source of 


Residual 




Variation 


Degrees of Sum of 

Freedom Squares 


Mean 

Square 


Variation 


Degrees of Sum of 
Freedom Squares 


Mean 

Square 


Total 


1,874 68,251.012 




Total 


1,873 52,843.630 




Within 

Groups 


1,873 68,060,093 


36.337 


Within 

Groups 


1,872 52,623.202 


28.111 


Between 

Groups 


1 190.919 


190.919 


Between 

Groups 


1 220.328 


220.328 




190.919 , 5254 
36.337 ^ 






„ 220.328 

28.111 “ 


7.838 




P< .05 






P < .01 





Table 33 

ADJUSTED MEANS ON THE 
SIXTH GRADE LISTENING COMPREHENSION TESTS 
PARENT PARTICIPATION VERSUS NO PARENT PARTICIPATION 





Means 




Test 


No Parent 


Parent 




Participation 


Participation 


First Semester 


31.079 


32.572 


Second Semester 


32,257 


33.011 



Table 3 ^ 

ADJUSTED MEANS ON THE 
SIXTH GRADS SPEAKING TESTS 
PARENT PARTICIPATION VERSUS NO PARENT PARTICIPATION 







Means 




Semester 

Test 


No Parent 
Participation 


Parent 

Participation 


First 




15 e 722 


15.874 


Second — 


Second Semester's 
Learning Reflected 


22.278 


22.027 


Second — 


Full Year's 
Learning Reflected 


22.248 


22.126 
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The activities suggested for participants in the parent-help method 
have been entirely audio-lingual in nature « that isy they have involved 
listening to and speaking Spanish but have not involved reading and vrriting. 

On the surface, it would seem that parent help should influence only the 
listening comprehension and speaking skills. However, if the prior conclusion 
that the method is partly effective because of increased motivation on the part 
of the child tc learn Spanish is valid, then pupils with parent help should 
perform better than the others on reading and %#riting tests. Pupils with parent 
help did perform better than those without such help on each reading and 
writing test, though the differences were not statistically significant for 
either semester alone. Vfliere full year learning was reflected, however, the 
F— ratio was 5*^28, and for n^^ of 1 and of 1,490, this F— ratio h a s pro- 
bability less than .05. The means for these analyses are shown in table 35* 

Table 35 

ADJUSTED MEANS ON THE 
SIXTH GRADE READING AND WRITING TESTS 
PARENT PARHCIPATION VERSUS NO PARENT PARTICIPATION 



Sonester 

Test 




Means 

No Parent 
Participation 


Parent 

Participation 


First 




22.180 


22.945 


Second — 


Second Semester's 
Learning Reflected 


17.079 


17.636 


Second — 


Full Year's 
Learning Reflected 


16.967 


18.024 



These results on reading and %#riting appear to validate the hypothesis 
that at least part of the effectiveness of parent participation: is motivational. 
Not only doe' the child perform better on tests of the understanding skill, he 
also demonstrates statistically significant superiority on reading and writing. 
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Overall, the sixth grade results constitute another strong endorsement of 
the parent— participant method* Two of the language skills, listening compre- 
hension and reading and writing, are definitely improved through parent help, 
and on speaking, the third skill, pupils whose parents participated did at least 
as well as those whose peurents were not involved. 

A-. Pupil and Teacher Interest 

Skills as Dependent Variables . As discussed previously, a set 
of teacher and pupil interest scales was developed by Educational Testing 
Service especially for the project and was used at sixth grade during I962-63. 
These scales were validated in terms of internal consistency only not 
against any external criterion. Therefore, results derived from their use 
3 ust be interpreted with some caution, thou^ their usefulness is not necessarily 
impaired. 

Assuming that the scales actually measured teacher and pupil interest in 
Spanish, the first question considered was, "What effect does teacher and 
pupil interest have on the amount pupils learn?” To answer this first question, 
the interest scale results were analyzed entirely as independent variables, 
with language skills as dependent variables. (First semester tests were 
used here because the interest scales were administered during the first 
semester. ) Table 36 gives the results of two two-dimensional analyses in which 
teacher interest and pupil post interest were the independent variables. 

Liste nin g comprehension is the dependent variable in one analysis, anH reading 
and writing is dependent in the other c 

The analyses show that both teacher interest and pupil interest produced 
significant differences on tests of the language skills and that there was no in- 
teraction. Furthermore, the larger effect was produced by pupil interest; the 
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F-ratios for this variable are on the order of 3 1/2 times larger than those for 
teacher interest. The adjusted means in table 37 were generally in the direction 
expected, that is, higher test means are related to higher interest. 



Table 36 

ANALYSES OF THE EFFECTS 
OF TEACHER AND PDPIL INTEREST 
ON SIXTH GRADE LANGUAGE SKILLS TESTS 



Listening Comprehension Test 


Source of 




Residual 








Variation 


Degress of Sun of 
Freedom Squares 


Mean 

Square 


F-ratio 


Probability 


Teacher 

Interest 


2 


3 ^ 3.'*59 


171.730 


4 . 69 <f 


< .01 


Pupil 

Interest 


2 


1 , 044.801 


522.401 


14.277 


< .001 


Interaction 


4 


62.978 


15.744 


0.430 


> .20 


Within 

Groups 


1,703 


62,308.597 


36.588 






Reading and Writing Test 


Source of 




Residual 








Variation 


Degrees of Sum of 
Freedom Squares 


Mean 

Square 


F-ratio 


^obability 


Teacher 

Interest 


2 


1,107.863 


553.932 


5.617 


< .01 


Pupil 

Interest 


2 


4,121.816 2,060.908 


20.897 


< .001 


Interaction 


4 


202.430 


50.608 


0.513 


> .20 


Within 

Groups 


1,703 


167,950.138 


98.620 
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Table 37 

ADJUSTED MEANS 
ON THE LANGUAGE SKILLS TESTS 
TEACHER INTEREST BY PUPIL INTEREST 



Pupil 

Interest 


Listening Comprehension 


Test 


Reading and Writing Test 






Teacher 


Interest 






Teacher Interest 




Low 


Middle 


High 


Total 


Low 


Middle 




Total 


Hle^ 


32.969 


32.761 


33.175 


32.9^ 


23.533 


22.427 


25.627 


23.733 


Middle 


32.213 


32.071 


33.416 


32.509 


24.492 


23.599 


24.708 


24.165 


Low 


30 . 75 ^ 


30.360 


31.567 


30.816 


20.904 


19.607 


21.051 


20.376 


Total 


31.947 


31.713 


32.795 


32.101 


23.087 


22.032 


23.881 


22.868 



Since both teacher interest and pupil interest produce statistically signi 
f leant differences in amount learned i it will be well to examine each effect 
in more detail. First, with regard to teacher interest, the question arises 
as to whether interest operates independently from experience and preparation. 
One would su^ect that, in general, the teachers hij^er in experience and pre- 
paration would be more likely to be hi^er in interest. In this case, the 
interest scales could be merely remeasuring teacher experience and preparation 
(TEP). T6 determine the relationship, a two-way table, with interest by TBP, 
was set up for sixth grade teachers, and related chi square computed. The 
results are shown in table 38* 

Table 38 indicates that, contrary to idiat mi^t be logically expected, 
t he re no correlation between teacher interest and teacher experience and 
preparation. The contingency coefficient for the in table 38 is . 13- 

Bo th teacher variables are important, therefore. Both have been shown 
to relate significantly to the amount pupils learn, and the results here show 
that they are independent. In this case, the best performance should be by 
pupils with teachers high in experience and preparation and also hi^ in in- 
terest. notion was tested through a two dimensional covariance analysis 
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with TEP and interest as independent variables and the understanding and reading and 
writing 11« as dependent variables* As in previous analyses « the independent 
variables produced statistically significant differences. Also significant, how- 
ever, were the interactions. With listening comprehension as the dependent variable , 
the interaction F-ratio was 5.95^» and with reading and writing as dependent, it was 
2.334. The related probabilities, for n^ of 4 and IL2 of 1.823, were, respectively, 

less than .CX)1 and approximately .06. 

Table 38 

BELATIONSHIP BETWEEN TEACHER INTEREST 
AND TEACHER EXPERIENCE AND PREPARATION 

Teacher Teacher Experience and Preparation qiimifican^ 



Interest 


Low 


Middle 


Hi^ 


oxgnxx c 

Test 


High 


27.59SIS 


23.8856 


30.0056 




Middle 


51.72 


40.30 


41.67 


x2 = 2.734 


Low 


20.69 


35.82 


28.33 


.50 < p < .70 


Total 


100 .00^ 


lOO.OMS 


100.006 




(N) 


(29) 


(67) 


(60) 





The best performances on both listening comprehension and reading and 
writing tests were, as hypothesized, by pupils with teachers high on each in- 
dependent variable. To this extent, the results are not surprising. The 
interaction, however, came as a complete surprise, and the pattern associated 
with it suggests some revealing conclusions regarding the teacher variables. 

The hi^ teacher interest and high experience and preparation condition 
is clearly desirable. But what happens when teacher interest is low? In 
that situation, experience and preparation does not have the advantageous 
effects one would expect. Indeed, for the listening comprehension skill, 
experience and preparation is a detriment if interest is low! The poorest 
performance of all was by pupils of teachers high in experience and preparation 
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but low in interest. One mi^t conclude, on observing these results, that a 
teacher can be expert in not teaching, as well as the other way around. 

Table 39 
adjusted means 

ON THE LANGUAGE SKILLS TESTS 

teacher interest by experience and preparation 



Comnrefaension Test Reading and Vlrlting Te st. 

TEP 



Teacher 




TEP 






TEP 


Interest 


Low 


Middle 


Hi^ 


Low 


Middle 


High 

Middle 

Low 


51.725 

30.610 

32.922 


32.243 

32.564 

32.227 


33.586 

31.187 

31.015 


21.237 

21.390 

20.841 


22.398 

22.713 

23.768 



23.967 

21.335 

22.961 



\<hich of the teacher variables under consideration is more important? 

Both have been shown to relate significantly to pupU learning. Furthermore, 
they have been found independent - a teacher's experience and preparation 
has nothing to do with his interest. Yet they interact, so that high levels 
of both are needed. This being the case, it is diffxcult to say vfliich is 
more important. The fact remains, however, that experience and preparation 
can be dealt with by a school system throu^ careful recruitment, inservice 
training, and summer workshops, while interest would seem to be much more of 

an individual matter with less chance for outside control. 

PupU Interest as Dependent Varlablg . Tables 56 and 37 showed pupil 
interest to exert even more influence on learning than teacher interest. 
Therefore, pupil interest also merits close examination, though, within the 
scope of the Denver-Stanford project, little more can be done with it as 
an independent variable. More important in this context is to determine 
what will effect pupil interest, that is. to treat pupU interest as a dependent 

rather than an independent variable. 
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Accordingly, pupil interest (measured at the end of the first semester) 
vas treated as a dependent variable in several, analyses* In these, an 
attempt was made to determine the effect on pupil interest of the following 
factors: teacher interest, teacher experience and preparation, parent participa- 

tion, experimental treatment, and pupil interest prior to beginning the sixth 
grade program (called ’’pupil pre-interest”). Significance tests, showing the 
influence of each of these on pupil interest, are given in table 4o. 

Table 40 

INFLUENCE OF 
SEVERAL FACTORS 
ON PUPIL INTEREST 



Effect 


F-ratio 


Degrees of Freedom 


Probability 






“1 


“2 






Teacher 

Interest 


0.683 


2 


1,750 


> .20 


TEP 


1.468 


2 


1-750 


> .05 


Parent 

Participation 


1.6l4 


1 


1,829 


> .05 


Experimental 

Treatment 


4.923 


9 


1,308 


< .001 


Pupil 

Pre-interest 


162.485 


3 


1,702 


< .001 



Of the five factors, only experimental treatment and pupil pre-interest 
had statistically significant effects on pupil interest, and a comparison of 
F-raiios shows that the most influence by far was exerted by pupil pre-interest. 
In other words, a pupil's interest in Spanish after a semester's work was 
determined largely by what he thought of it befOx*e he began the semester. 

Adjusted means, with pupil interest categorized by pre-interest and teacher 
interest, are shown in table 4l. The interaction for this analysis was not 
statistically significant. 




Table kl 



ADJUSTED 

PUPIL INTEREST MEANS 
PUPIL PRE-INTEREST BY TEACHER INTEREST 



Pupil 

Pre-interest 


Teacher Interest 




Low 


Middle 


High 


Total 


High 


14.013 


14.331 


14.860 


3A.415 


Hi^ Middle 


12,651 


12.477 


12.475 


12.524 


Low Middle 


9.048 


9.488 


10.025 


9.529 


Low 


6o590 


7,829 


7.450 


7.369 


Total 


10.941 


11.213 


11.362 


11.186 



The great influence of pre-interest on pupil interest, and the much 
smaller influence of teacher interest, are clearly shovm in table 4l. The 
means in every category of teacher interest are ranked precisely by pupil 
pre-interest, while teacher interest has little effect anywhere* 

These results have an obvious implication — that what happens to a 
child before he starts sixth grade Spanish is vitally important in shaping 
his attitude toward the subject in sixth grade. Sixth grade, of course, is the 
second year of Spanish for the child, and it follows a full year of work with 
a fifth grade teacher. Further, it is the second year in which the child’s 
parents %#ill or will not have participated. So it is not surprising that his 
attitudes toward Spanish are pretty well set when he starts sixth grade. 

While these resialts pinpoint the importance of the pupil's fifth grade 
experience, however, they do not relieve the sixth grade teacher of responsi- 
bility. This point is emphasized by table Thou^ the largest influence 

by far is pupil pre-interest, experimental treatment at sixth grade also 
produced differences significant beyond the .001 level. Table 42 gives ad- 
justed means when pupil interest is categorized by teacher interest and by 



exp^riflientsQ. treatment* The interaction for this breakdown wais significant 
beyond the .05 level. 



Table 42 



ADJUSTED 

PUPIL INTEREST MEANS 

EXPERIMENTAL TREATMENT BY TEACHER INTEREST 



Experimental 




Teacher Interest 




Treatment 


Low 


Middle High 


Total 





As 


10.706 


10.567 


10.908 


10.703 


As (R) 


10.540 


9.807 


10.761 


10.217 


Td 


10.178 


9.118 


11.904 


10.364 


TdAs 


9.504 


10.288 


9.078 


9.884 


TdAh 


12.053 


12.043 


12.187 


12.087 


TdAsEh 


11.372 


13.862 


9.875 


12.106 


TdAsC 


11.700 


12.588 


11.353 


11.932 


TdAhC 


11.905 


11.581 


11.344 


11.607 


EsAh 


10.780 


11.497 


12.129 


11.393 


EsAh (R) 


10.744 


12.289 


12.837 


12.285 



Most noticeable in table 42 is a clear division point, marked by the 
dashed line, between relatively low and relatively hi^ interest. The means 
below this line are consistently hi^er than those above it. What separates 
those practices below the line from those above it? The answer seemed to be 
that those practices below the line involve a greater variety of activities. 
All practices above the line had all instruction in the classroom during the 
regular 30 minute period each Tuesday, V/ednesday, and Thursday. All six 
practices below the line had some activity outside of this regualr period, 
and five of the six involve homework. The implication is clear: One way 

to increase a child's interest in Spamish at sixth grade is to add some out- 
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side activity, and homework appeals to be as eff^o-dve an additional activity 
as any. 

In a final analysis, teacher interest was the dependent variable and 
regular versus special teacher was the independent variable. The reader 
should recall that ’’regular versus special” refers to the teacher of subjects 

other than Spamish. A ’’regular” teacher was one who had the pupils for Spanish 

i 

j as well as all other academic subjects, and a ’’special” teacher was one who 

taught them Spanish only. The F-ratio for this analysis was 6.119i which, 
with n^^ of 1 and 112 of 175 1 is significant beyond the .02 level. The mean 
interest scores were 23«058 for special teachers and 21.316 for regular 
teacher; therefore, the special teachers showed significantly more interest 
in Spanish than did the regular teachers. 

Insofar as teacher interest per se is concerned, the special teachers seem 
to have an advantage, and this apparently counterbalances other advantages 
which accrue to regular teachers since results at both fifth and sixth grade 
showed no significant difference in amounts lecirned by pupils with special 
teachers and those with regular teachers. These results are important in 
their implication to an elementary school Spanish program. At present, many 
of the regular classroom teachers are not prepared to teach Spanish so that a 
special teacher must be used. The results show that the special teachers 
do the job quite well and that a child taking Spanish from a special teacher 
is likely to learn as much as one with a reguleu: teacher. 

C. Summary 

In summary, the sixth grade results confirmed the hypothesis that a 
combination of automated and teacher-directed instruction would be superior 
to either method alone. This combination produced significantly superior 
results on both the listening comprehension and reading and writing tests 

er|c 



when both types of instruction were given in the classroom in a complimentary 
manner. 

This combination produced somewhat less favorable results on speaking test, 
apparently because there were fewer chances to pratice spestking when automated 
instruction was used. However, it appears this deficiency can be partly over- 
come through use of electronic aids as an additional in-school activity which 
is scheduled outside of the regular Spanish instruction period. In this in- 
sta: ^e, the aids, together with additional reading material and cultural art- 
ifacts, were used as part of a Spanish corner. 

Results derived from special teacher and pupil interest scales showed 
that these variables indeed affect the amount a pupil learns. Teacher ex- 
perience and preparation also affects leaurning, '.^t not always in direct fashion. 
Rather, teacher experience and preparation interacts with teacher interest so 
that larger amounts of experience and preparation are valuable only when interest 
is hig^o 

Pupil interest related, as a dependent variable, to two factors. The 
stronger was pupil interest prior to the beginning of the school year, 
emphasizing the importance of the pupil’s experience in fifth grade. The 
second factor was experimental treatment. Pupil interest was significantly 
higher under those conditions which pre Tided some activity in addition to 
those of the regularly scheduled classroom period. Homework was one such 
additional activity. 

Parent participation, for the second year, was a valuable addition to 
the sixth grade activities. In fact, the interaction between prior Spanish 
and parent participation was not found at sixth grade; the method was effective 
for all pupils. 

Finally, pupils learned about the same amount whether they were tau^t 
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by their regular classroom teacher or by a special teacher who handled only 
the Spanish instruction. 

The following activities at sixth grade are therefore recommended: 
basic audio-lingual instruction by television, teacher-directed audio- 
lingual instruction by the eclectic method, reading and writing instruction 
in class by a combination of the teacher-directed aind automated methods, a 
Spanish corner in school, parent help at home, some additional homework, suid 
an on-going inservice teacher training program. 
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Standard Deviations and Variances on Each Test 
— Research Group 









Fifth 


Grade 














Listening Ccmprehension 


Speaking 




Research 


&*oup 




First 

Semester 


Second 

Semester 


First 

Semester 


Second 

Semester 




No Electronic Aids 




9.042 

81.758 


8.177 

66.863 


2.460 

6.052 


4.544 

20.648 




Electronic Aids 
Without Feedback 




7.131 

50.851 


7.482 

55.980 


2.460 

5.560 


4.224 

17.842 




Electronic Aids 
With Feedback 




7.376 

5 't.'t 05 


7.938 

63.012 


2.367 

5.603 


4.139 

17.131 




Total 






7.985 

63.769 


7.886 

62.197 


2.429 

5.902 


4.366 

19.070 










rixth Grade 












lasteoing Comprehension 


Reading and Writing 


Speaking 


Research 


Group 


First 

Semester 


Second 

Semester 


First 

Smnester 


Second 

Semester 


First 

Semester 


Second 

Semester 


As 


> 


6.819 

46.^99 


7.021 

49.294 


10.612 

112.615 


10.417 

108.514 






As(R) 




8.606 

7^.063 


8.577 

73.565 


13.307 

177.076 


12.030 

144.721 


5.485 

30.085 


6.306 

39.766 


EsAh 




7.^ 

55.711 


7.441 

55.368 


10.490 

110.040 


12.181 

148.377 


4.954 

24.542 


8.325 

69.306 


£sAh(R) 


> 


8.833 

78.022 


8.946 

80.031 


11.082 

122.811 


10.753 

115.627 


5.326 

28.366 


6.809 

46.362 


Td 




9.^77 

89.81^ 


8.299 

68.873 


12.490 

156.000 


11.831 

139.973 






TdAs 




8.160 

66.586 


7.953 

63.250 


12.700 

161.290 


12.245 

149.940 






TdAh 


> 


8.086 

65.383 


8.768 

76.878 


13.587 

184.607 


12.235 

149.695 


4.511 

20.349 


6.725 

45.226 


TdAsiSi 




8.882 

78.890 


8.725 

76.126 


12.962 

168.013 


12.329 

152.004 


4.910 

24.108 


4.61c 

57.912 


TdAsC 




7.355 

5^.096 


7.587 

57.563 


11.819 

139.689 


11.847 

140.351 






TdAhC 




8.973 

80.515 


8.703 

75.742 


11.491 

332.043 


10.763 

115.842 






Total 




8.342 

69.599 


8.308 

69.038 


12.396 

153.675 


11.857 

140.608 


5.060 

25.608 


7.068 

49.965 
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APPENDIX B 



Distribution of Classes by Class Size 



Fifth Grade 



Number of Pupils 


Number of Classes 


Percent 


0-19 


3 


1 . 69 ^ 


20-24 


11 


5.8 


25-29 


34 


18.1 


30-34 


70 


37.2 


35-39 


50 


26.6 


40-44 


15 


8.0 


45 - 49 


3 


1.6 


30 or more 


2 


1.1 


Total 


188 


100.09^ 




Sixth Grade 




Number of Pupils 


Number of Classes 


Percent 


0-19 


8 


4.495 


20-24 


14 


7.8 


25 - 29 


49 


27.2 


30-34 


58 


32.2 


35-39 


37 


20.6 


40-44 


9 


5.0 


45 - 49 


3 


1.7 


50 or more 


2 


1.1 



Total 180 100.09^ 



